![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9239 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8698 originally caused by: Started by upstream project "master-osmo-hlr" build number 8832 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17654 originally caused by: Started by upstream project "master-osmo-bsc" build number 20108 originally caused by: Started by upstream project "master-osmo-mgw" build number 9176 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30037 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37187 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29261 originally caused by: Started by upstream project "master-osmo-msc" build number 34205 originally caused by: Started by upstream project "master-osmo-mgw" build number 9176 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30038 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37188 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12966 originally caused by: Started by upstream project "master-openbsc" build number 13162 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30039 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37189 originally caused by: Started by upstream project "master-osmo-iuh" build number 12849 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29262 originally caused by: Started by upstream project "master-osmo-msc" build number 34206 originally caused by: Started by upstream project "master-osmo-iuh" build number 12849 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9109 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8699 originally caused by: Started by upstream project "master-osmo-hlr" build number 8833 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17654 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2949 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29262 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30039 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12966 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins986060770222023498.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 18:37:11 + trial_dir_prefix=trial- + rm -rf trial-2362 trial-2362-bin.tgz trial-2362-run.tgz + trial_dir=trial-2363 + mkdir -p trial-2363 + mv open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12966.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz trial-2363 + cat open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12966.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12966.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2363 combinations: None trial: 'trial-2363' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2363 -------------------------------------------------------------------------------------------- 18:37:22.904873 tst trial-2363: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/log --------------------------------------------------------------------- trial-2363 nitb_sms:sysmo --------------------------------------------------------------------- 18:39:30.090133 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:39:30.094957 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 18:39:30.122267 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 18:39:30.132664 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 18:39:30.198089 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 18:39:30.220381 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 18:39:30.227519 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 18:39:30.756810 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 18:39:30.761930 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 18:39:30.772266 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 18:39:31.173353 tst mo_mt_sms.py: using LAC 22947 18:39:31.421235 tst mo_mt_sms.py: using RAC 252 18:39:31.567502 tst mo_mt_sms.py: using CellId 22947 18:39:31.714367 tst mo_mt_sms.py: using BVCI 22948 18:39:31.830286 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 18:39:32.053157 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 18:39:32.186857 tst mo_mt_sms.py:9: start nitb and bts... 18:39:32.400349 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:39:34.713636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2032): Launched 18:39:35.027086 run osmo-nitb_10.42.42.2(pid=2033): Launched 18:39:35.198037 run osmo-nitb_10.42.42.2(pid=2033): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2033)] 18:39:35.327234 run osmo-nitb_10.42.42.2(pid=2033): stdout: | (launched: 2022-12-09_18:39:34.969788) 18:39:35.457382 run osmo-nitb_10.42.42.2(pid=2033): stderr: | (launched: 2022-12-09_18:39:35.016524) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:39:35.587950 run osmo-nitb_10.42.42.2(pid=2033): stdout: | (launched: 2022-12-09_18:39:34.969788) 18:39:35.713826 run osmo-nitb_10.42.42.2(pid=2033): stderr: | (launched: 2022-12-09_18:39:35.016524) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:39:35.863744 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2033): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2033) [trial-2363↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2033)] [trial-2363↪nitb_sms:sysmo↪mo_mt_sms.py:11] 18:39:35.872659 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 18:39:35.879798 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2032): Terminating (SIGTERM) 18:39:36.090912 --- ParallelTerminationStrategy: PID 2032 died... 18:39:36.112056 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2032): Terminated: ok {rc=0} 18:39:36.198617 bus /sierra_3: Setting Powered False 18:39:37.298714 bus /sierra_3: Setting Powered False 18:39:38.414549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:sysmo --------------------------------------------------------------------- 18:39:39.591001 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:39:39.594936 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 18:39:39.615201 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 18:39:39.641498 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 18:39:39.695693 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 18:39:39.717821 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 18:39:39.745090 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 18:39:40.285609 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:sysmo mo_mt_sms.py ---------------------------------------------- 18:39:40.290712 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.301210 tst sms:sysmo: Using 1 x bts (candidates: 1) 18:39:40.335604 tst mo_mt_sms.py: using LAC 22948 18:39:40.451305 tst mo_mt_sms.py: using RAC 253 18:39:40.574937 tst mo_mt_sms.py: using CellId 22948 18:39:40.697078 tst mo_mt_sms.py: using BVCI 22949 18:39:40.812079 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.823074 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.833914 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.845132 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.856346 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:39:40.867430 tst sms:sysmo: Using 1 x modem (candidates: 2) 18:39:40.979789 tst sms:sysmo: Using 1 x modem (candidates: 2) 18:39:41.095070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:42.784872 run create_hlr_db(pid=2037): Launched 18:39:42.907098 bus /sierra_2: Setting Powered False 18:39:43.969483 run create_hlr_db(pid=2037): Terminated: ok {rc=0} 18:39:44.408203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Launched 18:39:44.723041 run osmo-hlr_10.42.42.2(pid=2040): Launched 18:39:44.843618 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:47.455359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Launched 18:39:47.768439 run osmo-stp_10.42.42.5(pid=2043): Launched 18:39:47.887494 run osmo-msc_10.42.42.6: Starting osmo-msc 18:39:53.264290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2045): Launched 18:39:53.576655 run osmo-msc_10.42.42.6(pid=2046): Launched 18:39:53.751243 run osmo-stp_10.42.42.5(pid=2043): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] 18:39:53.882660 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-09_18:39:47.711002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:54.014745 run osmo-stp_10.42.42.5(pid=2043): stderr: | [0;m[38;5;43m20221209183947902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209183947902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209183947903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209183947903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183947905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183947905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183947906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:54.146528 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-09_18:39:47.711002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:54.271547 run osmo-stp_10.42.42.5(pid=2043): stderr: | [0;m[38;5;43m20221209183947902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209183947902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209183947903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209183947903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183947905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183947905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183947906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:54.421152 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2043): Process ended prematurely: osmo-stp_10.42.42.5(pid=2043) [trial-2363↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] [trial-2363↪sms:sysmo↪mo_mt_sms.py:16] 18:39:54.430130 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 18:39:54.457302 run osmo-hlr_10.42.42.2(pid=2040): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2040)] 18:39:54.507040 run osmo-hlr_10.42.42.2(pid=2040): stdout: | (launched: 2022-12-09_18:39:44.665278) 18:39:54.558614 run osmo-hlr_10.42.42.2(pid=2040): stderr: | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209183944862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209183944874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209183944883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183944883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183944883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:54.629277 run osmo-msc_10.42.42.6(pid=2046): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2046)] 18:39:54.678906 run osmo-msc_10.42.42.6(pid=2046): stdout: | (launched: 2022-12-09_18:39:53.519522) 18:39:54.729735 run osmo-msc_10.42.42.6(pid=2046): stderr: | [0;m[38;5;43m20221209183953842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209183953842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ae39c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209183953842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209183953842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209183953842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209183953843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209183953844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209183953845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183953845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183953845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:39:54.780823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminating (SIGTERM) 18:39:54.821848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminating (SIGTERM) 18:39:54.862822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2045): Terminating (SIGTERM) 18:39:54.904139 --- ParallelTerminationStrategy: PID 2039 died... 18:39:54.923836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminated: ok {rc=0} 18:39:54.970196 --- ParallelTerminationStrategy: PID 2042 died... 18:39:54.989543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminated: ok {rc=0} 18:39:55.035533 --- ParallelTerminationStrategy: PID 2045 died... 18:39:55.054873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2045): Terminated: ok {rc=0} 18:39:55.142149 bus /sierra_3: Setting Powered False 18:39:56.240739 bus /sierra_3: Setting Powered False 18:39:57.356301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:sysmo --------------------------------------------------------------------- 18:39:58.575149 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:39:58.579941 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 18:39:58.601853 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 18:39:58.609683 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 18:39:58.645423 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 18:39:58.666599 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 18:39:58.673682 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 18:39:59.193488 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 18:39:59.198852 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 18:39:59.210053 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 18:39:59.245936 tst assert_extension.py: using LAC 22949 18:39:59.370554 tst assert_extension.py: using RAC 254 18:39:59.494341 tst assert_extension.py: using CellId 22949 18:39:59.617539 tst assert_extension.py: using BVCI 22950 18:39:59.724626 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 18:39:59.838403 tst assert_extension.py:10: start nitb and bts... 18:40:00.034102 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:40:00.631414 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2051): Launched 18:40:00.959983 run osmo-nitb_10.42.42.2(pid=2052): Launched 18:40:01.238076 run osmo-nitb_10.42.42.2(pid=2052): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2052)] 18:40:01.391528 run osmo-nitb_10.42.42.2(pid=2052): stdout: | (launched: 2022-12-09_18:40:00.895597) 18:40:01.585972 run osmo-nitb_10.42.42.2(pid=2052): stderr: | (launched: 2022-12-09_18:40:00.944071) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:40:01.735413 run osmo-nitb_10.42.42.2(pid=2052): stdout: | (launched: 2022-12-09_18:40:00.895597) 18:40:01.884558 run osmo-nitb_10.42.42.2(pid=2052): stderr: | (launched: 2022-12-09_18:40:00.944071) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2052) [trial-2363↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2052)] 18:40:02.136039 tst osmo-nitb_10.42.42.2(pid=2052): stdout: | (launched: 2022-12-09_18:40:00.895597) 18:40:02.259406 tst osmo-nitb_10.42.42.2(pid=2052): stderr: | (launched: 2022-12-09_18:40:00.944071) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:40:02.401789 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2052) [trial-2363↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2052)] [trial-2363↪nitb_ussd:sysmo↪assert_extension.py:12] 18:40:02.410939 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:40:02.418185 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2051): Terminating (SIGTERM) 18:40:02.627785 --- ParallelTerminationStrategy: PID 2051 died... 18:40:02.648418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2051): Terminated: ok {rc=0} 18:40:02.732217 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:sysmo --------------------------------------------------------------------- 18:40:03.956809 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:03.961499 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 18:40:03.983197 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 18:40:04.010357 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 18:40:04.043566 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 18:40:04.065263 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 18:40:04.092673 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 18:40:04.619359 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:sysmo assert_extension.py ---------------------------------------------- 18:40:04.624850 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:04.635658 tst ussd:sysmo: Using 1 x bts (candidates: 1) 18:40:04.669331 tst assert_extension.py: using LAC 22950 18:40:04.783113 tst assert_extension.py: using RAC 255 18:40:04.896103 tst assert_extension.py: using CellId 22950 18:40:05.009380 tst assert_extension.py: using BVCI 22951 18:40:05.114891 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:05.125255 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:05.135449 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:05.145703 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:05.155790 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:40:05.165923 tst ussd:sysmo: Using 1 x modem (candidates: 1) 18:40:05.280462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:05.769071 run create_hlr_db(pid=2060): Launched 18:40:05.888639 bus /sierra_2: Setting Powered False 18:40:06.951291 run create_hlr_db(pid=2060): Terminated: ok {rc=0} 18:40:07.389103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Launched 18:40:07.703089 run osmo-hlr_10.42.42.2(pid=2063): Launched 18:40:07.823260 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:08.332141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Launched 18:40:08.625493 run osmo-stp_10.42.42.5(pid=2066): Launched 18:40:08.736017 run osmo-msc_10.42.42.6: Starting osmo-msc 18:40:09.261641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2068): Launched 18:40:09.553071 run osmo-msc_10.42.42.6(pid=2069): Launched 18:40:09.716152 run osmo-stp_10.42.42.5(pid=2066): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] 18:40:09.839762 run osmo-stp_10.42.42.5(pid=2066): stdout: | (launched: 2022-12-09_18:40:08.571545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:09.963395 run osmo-stp_10.42.42.5(pid=2066): stderr: | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184008743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:10.085188 run osmo-stp_10.42.42.5(pid=2066): stdout: | (launched: 2022-12-09_18:40:08.571545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:10.201829 run osmo-stp_10.42.42.5(pid=2066): stderr: | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184008742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184008743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184008743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:10.341599 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2066): Process ended prematurely: osmo-stp_10.42.42.5(pid=2066) [trial-2363↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] [trial-2363↪ussd:sysmo↪assert_extension.py:17] 18:40:10.349820 tst assert_extension.py:17: Test FAILED (5.7 sec) 18:40:10.374995 run osmo-hlr_10.42.42.2(pid=2063): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2063)] 18:40:10.421539 run osmo-hlr_10.42.42.2(pid=2063): stdout: | (launched: 2022-12-09_18:40:07.645258) 18:40:10.469640 run osmo-hlr_10.42.42.2(pid=2063): stderr: | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184007841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184007868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184007879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184007879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184007879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:10.537261 run osmo-msc_10.42.42.6(pid=2069): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2069)] 18:40:10.583881 run osmo-msc_10.42.42.6(pid=2069): stdout: | (launched: 2022-12-09_18:40:09.499120) 18:40:10.631998 run osmo-msc_10.42.42.6(pid=2069): stderr: | [0;m[38;5;43m20221209184009770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184009770 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d44895c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184009770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184009770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184009770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184009771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184009775 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184009775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184009775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184009776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:40:10.680458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Terminating (SIGTERM) 18:40:10.718857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Terminating (SIGTERM) 18:40:10.757207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2068): Terminating (SIGTERM) 18:40:10.795662 --- ParallelTerminationStrategy: PID 2062 died... 18:40:10.814075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Terminated: ok {rc=0} 18:40:10.856564 --- ParallelTerminationStrategy: PID 2065 died... 18:40:10.874578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Terminated: ok {rc=0} 18:40:10.917712 --- ParallelTerminationStrategy: PID 2068 died... 18:40:10.935648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2068): Terminated: ok {rc=0} 18:40:11.016282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:40:12.229877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:12.236942 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:40:12.260373 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:40:12.287008 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:40:12.335619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:40:12.355945 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:40:12.381530 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:40:12.933307 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:40:12.982340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:12.993170 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:40:13.046949 tst mo_mt_call.py: using LAC 22951 18:40:13.164260 tst mo_mt_call.py: using RAC 1 18:40:13.279230 tst mo_mt_call.py: using CellId 22951 18:40:13.395532 tst mo_mt_call.py: using BVCI 22952 18:40:13.502427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:13.513369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:13.523951 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:13.534627 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:13.545216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:13.555860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:40:13.667976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:40:13.785447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:14.280370 run create_hlr_db(pid=2074): Launched 18:40:14.402560 bus /sierra_2: Setting Powered False 18:40:15.465704 run create_hlr_db(pid=2074): Terminated: ok {rc=0} 18:40:15.919363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2076): Launched 18:40:16.269609 run osmo-hlr_10.42.42.2(pid=2077): Launched 18:40:16.512909 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:17.203945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2079): Launched 18:40:17.506724 run osmo-stp_10.42.42.5(pid=2080): Launched 18:40:17.620048 run osmo-msc_10.42.42.6: Starting osmo-msc 18:40:18.156162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2082): Launched 18:40:18.452641 run osmo-msc_10.42.42.6(pid=2083): Launched 18:40:18.619102 run osmo-stp_10.42.42.5(pid=2080): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2080)] 18:40:18.744361 run osmo-stp_10.42.42.5(pid=2080): stdout: | (launched: 2022-12-09_18:40:17.450766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:18.870181 run osmo-stp_10.42.42.5(pid=2080): stderr: | [0;m[38;5;43m20221209184017621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184017621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184017622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184017622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184017622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184017622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184017623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:18.994016 run osmo-stp_10.42.42.5(pid=2080): stdout: | (launched: 2022-12-09_18:40:17.450766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:19.112211 run osmo-stp_10.42.42.5(pid=2080): stderr: | [0;m[38;5;43m20221209184017621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184017621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184017622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184017622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184017622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184017622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184017623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:19.254375 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2080): Process ended prematurely: osmo-stp_10.42.42.5(pid=2080) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2080)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:40:19.262872 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:40:19.288547 run osmo-hlr_10.42.42.2(pid=2077): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2077)] 18:40:19.335378 run osmo-hlr_10.42.42.2(pid=2077): stdout: | (launched: 2022-12-09_18:40:16.205995) 18:40:19.384309 run osmo-hlr_10.42.42.2(pid=2077): stderr: | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184016596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184016611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184016620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184016620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184016620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:19.451808 run osmo-msc_10.42.42.6(pid=2083): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2083)] 18:40:19.498741 run osmo-msc_10.42.42.6(pid=2083): stdout: | (launched: 2022-12-09_18:40:18.397809) 18:40:19.547088 run osmo-msc_10.42.42.6(pid=2083): stderr: | [0;m[38;5;43m20221209184018671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184018671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01a1cd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184018671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184018671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184018672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184018672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184018674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184018674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184018674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184018674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:40:19.595913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2076): Terminating (SIGTERM) 18:40:19.634720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2079): Terminating (SIGTERM) 18:40:19.673532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2082): Terminating (SIGTERM) 18:40:19.713123 --- ParallelTerminationStrategy: PID 2076 died... 18:40:19.731637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2076): Terminated: ok {rc=0} 18:40:19.774906 --- ParallelTerminationStrategy: PID 2079 died... 18:40:19.792891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2079): Terminated: ok {rc=0} 18:40:19.835772 --- ParallelTerminationStrategy: PID 2082 died... 18:40:19.853819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2082): Terminated: ok {rc=0} 18:40:19.937113 bus /sierra_3: Setting Powered False 18:40:21.035775 bus /sierra_3: Setting Powered False 18:40:22.149836 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:40:23.298329 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.309777 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:40:23.365061 tst mo_mt_call_osmux.py: using LAC 22952 18:40:23.482381 tst mo_mt_call_osmux.py: using RAC 2 18:40:23.602651 tst mo_mt_call_osmux.py: using CellId 22952 18:40:23.720867 tst mo_mt_call_osmux.py: using BVCI 22953 18:40:23.828434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.839246 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.849865 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.860366 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.871034 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:40:23.881668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:40:23.998329 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:40:24.111803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:24.573299 run create_hlr_db(pid=2085): Launched 18:40:24.695424 bus /sierra_2: Setting Powered False 18:40:25.754686 run create_hlr_db(pid=2085): Terminated: ok {rc=0} 18:40:26.190729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2087): Launched 18:40:26.509657 run osmo-hlr_10.42.42.2(pid=2088): Launched 18:40:26.631722 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:27.181084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2090): Launched 18:40:27.500470 run osmo-stp_10.42.42.5(pid=2091): Launched 18:40:27.622398 run osmo-msc_10.42.42.6: Starting osmo-msc 18:40:28.198599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2093): Launched 18:40:28.517151 run osmo-msc_10.42.42.6(pid=2094): Launched 18:40:28.696282 run osmo-stp_10.42.42.5(pid=2091): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2091)] 18:40:28.831833 run osmo-stp_10.42.42.5(pid=2091): stdout: | (launched: 2022-12-09_18:40:27.442222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:28.967441 run osmo-stp_10.42.42.5(pid=2091): stderr: | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184027637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:29.102503 run osmo-stp_10.42.42.5(pid=2091): stdout: | (launched: 2022-12-09_18:40:27.442222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:29.230017 run osmo-stp_10.42.42.5(pid=2091): stderr: | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184027636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184027637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:29.382521 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2091): Process ended prematurely: osmo-stp_10.42.42.5(pid=2091) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2091)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:40:29.391979 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:40:29.420306 run osmo-hlr_10.42.42.2(pid=2088): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2088)] 18:40:29.469890 run osmo-hlr_10.42.42.2(pid=2088): stdout: | (launched: 2022-12-09_18:40:26.451488) 18:40:29.521136 run osmo-hlr_10.42.42.2(pid=2088): stderr: | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184026650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184026689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184026699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184026699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184026699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:29.592107 run osmo-msc_10.42.42.6(pid=2094): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2094)] 18:40:29.641605 run osmo-msc_10.42.42.6(pid=2094): stdout: | (launched: 2022-12-09_18:40:28.458885) 18:40:29.692796 run osmo-msc_10.42.42.6(pid=2094): stderr: | [0;m[38;5;43m20221209184028780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184028780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ea4aa4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184028780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184028780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184028781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184028781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184028784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184028785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184028785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184028785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:40:29.744136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2087): Terminating (SIGTERM) 18:40:29.785209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2090): Terminating (SIGTERM) 18:40:29.826470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2093): Terminating (SIGTERM) 18:40:29.867884 --- ParallelTerminationStrategy: PID 2087 died... 18:40:29.887516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2087): Terminated: ok {rc=0} 18:40:29.933743 --- ParallelTerminationStrategy: PID 2090 died... 18:40:29.952631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2090): Terminated: ok {rc=0} 18:40:29.998373 --- ParallelTerminationStrategy: PID 2093 died... 18:40:30.017452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2093): Terminated: ok {rc=0} 18:40:30.104391 bus /sierra_3: Setting Powered False 18:40:31.199817 bus /sierra_3: Setting Powered False 18:40:32.313477 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:40:33.545172 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:33.552651 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:40:33.574205 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:40:33.601050 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:40:33.651914 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:40:33.672376 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:40:33.698021 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:40:34.251923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:40:34.304069 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.315233 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:40:34.370145 tst mo_mt_call.py: using LAC 22953 18:40:34.494862 tst mo_mt_call.py: using RAC 3 18:40:34.618419 tst mo_mt_call.py: using CellId 22953 18:40:34.742152 tst mo_mt_call.py: using BVCI 22954 18:40:34.858121 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.869493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.880462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.891730 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.903060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:34.914337 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:40:35.030408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:40:35.143699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:35.607209 run create_hlr_db(pid=2099): Launched 18:40:35.728397 bus /sierra_2: Setting Powered False 18:40:36.787913 run create_hlr_db(pid=2099): Terminated: ok {rc=0} 18:40:37.224186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Launched 18:40:37.543730 run osmo-hlr_10.42.42.2(pid=2102): Launched 18:40:37.665952 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:38.221342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Launched 18:40:38.540182 run osmo-stp_10.42.42.5(pid=2105): Launched 18:40:38.662360 run osmo-msc_10.42.42.6: Starting osmo-msc 18:40:39.240477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2107): Launched 18:40:39.559431 run osmo-msc_10.42.42.6(pid=2108): Launched 18:40:39.737376 run osmo-stp_10.42.42.5(pid=2105): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] 18:40:39.871935 run osmo-stp_10.42.42.5(pid=2105): stdout: | (launched: 2022-12-09_18:40:38.481889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:40.007811 run osmo-stp_10.42.42.5(pid=2105): stderr: | [0;m[38;5;43m20221209184038674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184038674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184038675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184038675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184038677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184038678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184038678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:40.142823 run osmo-stp_10.42.42.5(pid=2105): stdout: | (launched: 2022-12-09_18:40:38.481889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:40.270333 run osmo-stp_10.42.42.5(pid=2105): stderr: | [0;m[38;5;43m20221209184038674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184038674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184038675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184038675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184038677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184038678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184038678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:40.422604 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2105): Process ended prematurely: osmo-stp_10.42.42.5(pid=2105) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:40:40.431818 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:40:40.459404 run osmo-hlr_10.42.42.2(pid=2102): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2102)] 18:40:40.508431 run osmo-hlr_10.42.42.2(pid=2102): stdout: | (launched: 2022-12-09_18:40:37.485509) 18:40:40.559498 run osmo-hlr_10.42.42.2(pid=2102): stderr: | [0;m[1;31m20221209184037684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184037684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184037684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184037684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184037684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184037685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184037696 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184037704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184037704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184037704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:40.629549 run osmo-msc_10.42.42.6(pid=2108): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2108)] 18:40:40.678584 run osmo-msc_10.42.42.6(pid=2108): stdout: | (launched: 2022-12-09_18:40:39.501181) 18:40:40.729507 run osmo-msc_10.42.42.6(pid=2108): stderr: | [0;m[38;5;43m20221209184039821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184039821 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc07593c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184039821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184039821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184039821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184039822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184039823 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184039824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184039824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184039824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:40:40.780867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Terminating (SIGTERM) 18:40:40.821608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Terminating (SIGTERM) 18:40:40.862223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2107): Terminating (SIGTERM) 18:40:40.902944 --- ParallelTerminationStrategy: PID 2101 died... 18:40:40.922316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Terminated: ok {rc=0} 18:40:40.967487 --- ParallelTerminationStrategy: PID 2104 died... 18:40:40.986281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Terminated: ok {rc=0} 18:40:41.031831 --- ParallelTerminationStrategy: PID 2107 died... 18:40:41.050936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2107): Terminated: ok {rc=0} 18:40:41.137435 bus /sierra_3: Setting Powered False 18:40:42.234714 bus /sierra_3: Setting Powered False 18:40:43.347810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:40:44.494261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:44.506044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:40:44.563278 tst mo_mt_call_osmux.py: using LAC 22954 18:40:44.690878 tst mo_mt_call_osmux.py: using RAC 4 18:40:44.817810 tst mo_mt_call_osmux.py: using CellId 22954 18:40:44.943599 tst mo_mt_call_osmux.py: using BVCI 22955 18:40:45.059376 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:45.070661 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:45.081820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:45.093083 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:45.104336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:40:45.115843 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:40:45.232846 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:40:45.345949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:45.807296 run create_hlr_db(pid=2111): Launched 18:40:45.949749 bus /sierra_2: Setting Powered False 18:40:47.011880 run create_hlr_db(pid=2111): Terminated: ok {rc=0} 18:40:47.465555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2113): Launched 18:40:47.785658 run osmo-hlr_10.42.42.2(pid=2114): Launched 18:40:47.907187 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:48.462081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2116): Launched 18:40:48.782290 run osmo-stp_10.42.42.5(pid=2117): Launched 18:40:48.904085 run osmo-msc_10.42.42.6: Starting osmo-msc 18:40:49.481301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2119): Launched 18:40:49.801463 run osmo-msc_10.42.42.6(pid=2120): Launched 18:40:49.979532 run osmo-stp_10.42.42.5(pid=2117): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2117)] 18:40:50.114721 run osmo-stp_10.42.42.5(pid=2117): stdout: | (launched: 2022-12-09_18:40:48.723267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:50.250399 run osmo-stp_10.42.42.5(pid=2117): stderr: | [0;m[38;5;43m20221209184048915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184048915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184048916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184048916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184048916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184048917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184048917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:50.385328 run osmo-stp_10.42.42.5(pid=2117): stdout: | (launched: 2022-12-09_18:40:48.723267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:50.512756 run osmo-stp_10.42.42.5(pid=2117): stderr: | [0;m[38;5;43m20221209184048915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184048915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184048916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184048916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184048916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184048917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184048917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:50.665341 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2117): Process ended prematurely: osmo-stp_10.42.42.5(pid=2117) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2117)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:40:50.674576 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:40:50.702618 run osmo-hlr_10.42.42.2(pid=2114): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2114)] 18:40:50.751990 run osmo-hlr_10.42.42.2(pid=2114): stdout: | (launched: 2022-12-09_18:40:47.727410) 18:40:50.803338 run osmo-hlr_10.42.42.2(pid=2114): stderr: | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184047924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184047935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184047945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184047945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184047945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:50.874511 run osmo-msc_10.42.42.6(pid=2120): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2120)] 18:40:50.924114 run osmo-msc_10.42.42.6(pid=2120): stdout: | (launched: 2022-12-09_18:40:49.742697) 18:40:50.975190 run osmo-msc_10.42.42.6(pid=2120): stderr: | [0;m[38;5;43m20221209184050065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184050065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30f7168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184050065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184050065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184050065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184050065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184050067 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184050067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184050068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184050068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:40:51.026637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2113): Terminating (SIGTERM) 18:40:51.067921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2116): Terminating (SIGTERM) 18:40:51.109188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2119): Terminating (SIGTERM) 18:40:51.150577 --- ParallelTerminationStrategy: PID 2113 died... 18:40:51.170156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2113): Terminated: ok {rc=0} 18:40:51.215885 --- ParallelTerminationStrategy: PID 2116 died... 18:40:51.235100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2116): Terminated: ok {rc=0} 18:40:51.280768 --- ParallelTerminationStrategy: PID 2119 died... 18:40:51.299932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2119): Terminated: ok {rc=0} 18:40:51.386676 bus /sierra_3: Setting Powered False 18:40:52.483989 bus /sierra_3: Setting Powered False 18:40:53.597915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:40:54.830594 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:54.837466 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:40:54.859562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:40:54.886871 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:40:54.938440 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:40:54.959423 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:40:54.986333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:40:55.538745 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:40:55.590264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:55.601580 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:40:55.660899 tst mo_mt_call.py: using LAC 22955 18:40:55.786344 tst mo_mt_call.py: using RAC 5 18:40:55.909285 tst mo_mt_call.py: using CellId 22955 18:40:56.032670 tst mo_mt_call.py: using BVCI 22956 18:40:56.148748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:56.160205 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:56.171300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:56.182664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:56.193946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:40:56.205343 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:40:56.324874 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:40:56.439156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:56.903389 run create_hlr_db(pid=2125): Launched 18:40:57.025164 bus /sierra_2: Setting Powered False 18:40:58.084580 run create_hlr_db(pid=2125): Terminated: ok {rc=0} 18:40:58.522585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2127): Launched 18:40:58.843326 run osmo-hlr_10.42.42.2(pid=2128): Launched 18:40:58.965786 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:59.519006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2130): Launched 18:40:59.839212 run osmo-stp_10.42.42.5(pid=2131): Launched 18:40:59.961407 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:00.539463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2133): Launched 18:41:00.848225 run osmo-msc_10.42.42.6(pid=2134): Launched 18:41:01.238464 run osmo-stp_10.42.42.5(pid=2131): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2131)] 18:41:01.404550 run osmo-stp_10.42.42.5(pid=2131): stdout: | (launched: 2022-12-09_18:40:59.780688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:01.571518 run osmo-stp_10.42.42.5(pid=2131): stderr: | [0;m[38;5;43m20221209184059971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184059972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184059972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184059972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:01.700663 run osmo-stp_10.42.42.5(pid=2131): stdout: | (launched: 2022-12-09_18:40:59.780688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:01.822950 run osmo-stp_10.42.42.5(pid=2131): stderr: | [0;m[38;5;43m20221209184059971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184059972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184059972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184059972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184059973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:01.968791 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2131): Process ended prematurely: osmo-stp_10.42.42.5(pid=2131) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2131)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:41:01.978017 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:41:02.004291 run osmo-hlr_10.42.42.2(pid=2128): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2128)] 18:41:02.052544 run osmo-hlr_10.42.42.2(pid=2128): stdout: | (launched: 2022-12-09_18:40:58.785094) 18:41:02.101834 run osmo-hlr_10.42.42.2(pid=2128): stderr: | [0;m[1;31m20221209184058981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184058982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184058982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184058982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184058982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184058982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184059000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184059010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184059010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184059010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:02.171360 run osmo-msc_10.42.42.6(pid=2134): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2134)] 18:41:02.219275 run osmo-msc_10.42.42.6(pid=2134): stdout: | (launched: 2022-12-09_18:41:00.788454) 18:41:02.268636 run osmo-msc_10.42.42.6(pid=2134): stderr: | [0;m[38;5;43m20221209184101236 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184101245 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb5c3f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184101245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184101245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184101245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184101246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184101247 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184101248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184101248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184101248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:02.318736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2127): Terminating (SIGTERM) 18:41:02.360055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2130): Terminating (SIGTERM) 18:41:02.402076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2133): Terminating (SIGTERM) 18:41:02.443344 --- ParallelTerminationStrategy: PID 2127 died... 18:41:02.463494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2127): Terminated: ok {rc=0} 18:41:02.507520 --- ParallelTerminationStrategy: PID 2130 died... 18:41:02.526422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2130): Terminated: ok {rc=0} 18:41:02.570249 --- ParallelTerminationStrategy: PID 2133 died... 18:41:02.588503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2133): Terminated: ok {rc=0} 18:41:02.672230 bus /sierra_3: Setting Powered False 18:41:03.770034 bus /sierra_3: Setting Powered False 18:41:04.883590 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:41:06.027832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.039258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:41:06.094846 tst mo_mt_call_osmux.py: using LAC 22956 18:41:06.214201 tst mo_mt_call_osmux.py: using RAC 6 18:41:06.335372 tst mo_mt_call_osmux.py: using CellId 22956 18:41:06.451693 tst mo_mt_call_osmux.py: using BVCI 22957 18:41:06.559509 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.570362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.580898 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.591568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.602140 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:41:06.612812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:41:06.725935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:41:06.845762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:07.309635 run create_hlr_db(pid=2136): Launched 18:41:07.430393 bus /sierra_2: Setting Powered False 18:41:08.489965 run create_hlr_db(pid=2136): Terminated: ok {rc=0} 18:41:08.934742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2138): Launched 18:41:09.255673 run osmo-hlr_10.42.42.2(pid=2139): Launched 18:41:09.377793 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:09.893890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2141): Launched 18:41:10.192144 run osmo-stp_10.42.42.5(pid=2142): Launched 18:41:10.304768 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:10.843697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2144): Launched 18:41:11.143540 run osmo-msc_10.42.42.6(pid=2145): Launched 18:41:11.310058 run osmo-stp_10.42.42.5(pid=2142): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2142)] 18:41:11.435684 run osmo-stp_10.42.42.5(pid=2142): stdout: | (launched: 2022-12-09_18:41:10.137283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:11.562027 run osmo-stp_10.42.42.5(pid=2142): stderr: | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184110307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:11.686941 run osmo-stp_10.42.42.5(pid=2142): stdout: | (launched: 2022-12-09_18:41:10.137283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:11.806217 run osmo-stp_10.42.42.5(pid=2142): stderr: | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184110306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184110307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184110307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:11.948891 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2142): Process ended prematurely: osmo-stp_10.42.42.5(pid=2142) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2142)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:41:11.957717 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:41:11.983935 run osmo-hlr_10.42.42.2(pid=2139): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2139)] 18:41:12.031702 run osmo-hlr_10.42.42.2(pid=2139): stdout: | (launched: 2022-12-09_18:41:09.197478) 18:41:12.080685 run osmo-hlr_10.42.42.2(pid=2139): stderr: | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184109396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184109407 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184109415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184109415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184109416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:12.148751 run osmo-msc_10.42.42.6(pid=2145): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2145)] 18:41:12.196412 run osmo-msc_10.42.42.6(pid=2145): stdout: | (launched: 2022-12-09_18:41:11.088360) 18:41:12.245380 run osmo-msc_10.42.42.6(pid=2145): stderr: | [0;m[38;5;43m20221209184111362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184111362 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9999408c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184111362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184111362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184111362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184111362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184111364 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184111364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184111365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184111365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:12.294435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2138): Terminating (SIGTERM) 18:41:12.333605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2141): Terminating (SIGTERM) 18:41:12.373134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2144): Terminating (SIGTERM) 18:41:12.412749 --- ParallelTerminationStrategy: PID 2138 died... 18:41:12.431426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2138): Terminated: ok {rc=0} 18:41:12.475561 --- ParallelTerminationStrategy: PID 2141 died... 18:41:12.493708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2141): Terminated: ok {rc=0} 18:41:12.537871 --- ParallelTerminationStrategy: PID 2144 died... 18:41:12.556031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2144): Terminated: ok {rc=0} 18:41:12.640522 bus /sierra_3: Setting Powered False 18:41:13.738541 bus /sierra_3: Setting Powered False 18:41:14.852206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:41:16.135618 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:16.147001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:41:16.173369 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:41:16.205978 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:41:16.267818 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:41:16.297276 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:41:16.334403 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:41:16.863337 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:41:16.914928 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:16.926843 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:41:16.983379 tst mo_mt_call.py: using LAC 22957 18:41:17.121979 tst mo_mt_call.py: using RAC 7 18:41:17.248760 tst mo_mt_call.py: using CellId 22957 18:41:17.379546 tst mo_mt_call.py: using BVCI 22958 18:41:17.497283 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:17.508523 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:17.519493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:17.531115 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:17.542444 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:17.553804 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:41:17.669456 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:41:17.788420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:18.284153 run create_hlr_db(pid=2150): Launched 18:41:18.405617 bus /sierra_2: Setting Powered False 18:41:19.469205 run create_hlr_db(pid=2150): Terminated: ok {rc=0} 18:41:19.895108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2152): Launched 18:41:20.192885 run osmo-hlr_10.42.42.2(pid=2153): Launched 18:41:20.305923 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:20.833056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2155): Launched 18:41:21.130599 run osmo-stp_10.42.42.5(pid=2156): Launched 18:41:21.244547 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:21.784062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2158): Launched 18:41:22.081707 run osmo-msc_10.42.42.6(pid=2159): Launched 18:41:22.246788 run osmo-stp_10.42.42.5(pid=2156): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2156)] 18:41:22.372145 run osmo-stp_10.42.42.5(pid=2156): stdout: | (launched: 2022-12-09_18:41:21.075717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:22.497512 run osmo-stp_10.42.42.5(pid=2156): stderr: | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184121247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:22.621127 run osmo-stp_10.42.42.5(pid=2156): stdout: | (launched: 2022-12-09_18:41:21.075717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:22.738904 run osmo-stp_10.42.42.5(pid=2156): stderr: | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184121247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184121247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184121248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:22.880869 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2156): Process ended prematurely: osmo-stp_10.42.42.5(pid=2156) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2156)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:41:22.889610 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:41:22.915154 run osmo-hlr_10.42.42.2(pid=2153): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2153)] 18:41:22.961052 run osmo-hlr_10.42.42.2(pid=2153): stdout: | (launched: 2022-12-09_18:41:20.138112) 18:41:23.008522 run osmo-hlr_10.42.42.2(pid=2153): stderr: | [0;m[1;31m20221209184120312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184120312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184120312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184120313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184120313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184120313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184120325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184120334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184120334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184120334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:23.075373 run osmo-msc_10.42.42.6(pid=2159): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2159)] 18:41:23.121452 run osmo-msc_10.42.42.6(pid=2159): stdout: | (launched: 2022-12-09_18:41:22.026718) 18:41:23.169154 run osmo-msc_10.42.42.6(pid=2159): stderr: | [0;m[38;5;43m20221209184122302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184122302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a5f490c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184122302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184122302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184122303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184122303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184122304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184122305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184122305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184122305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:23.217216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2152): Terminating (SIGTERM) 18:41:23.255820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2155): Terminating (SIGTERM) 18:41:23.294098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2158): Terminating (SIGTERM) 18:41:23.332548 --- ParallelTerminationStrategy: PID 2152 died... 18:41:23.350908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2152): Terminated: ok {rc=0} 18:41:23.393427 --- ParallelTerminationStrategy: PID 2155 died... 18:41:23.411375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2155): Terminated: ok {rc=0} 18:41:23.453542 --- ParallelTerminationStrategy: PID 2158 died... 18:41:23.471392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2158): Terminated: ok {rc=0} 18:41:23.554867 bus /sierra_3: Setting Powered False 18:41:24.651276 bus /sierra_3: Setting Powered False 18:41:25.764007 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:41:26.905997 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:26.917274 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:41:26.972083 tst mo_mt_call_osmux.py: using LAC 22958 18:41:27.088295 tst mo_mt_call_osmux.py: using RAC 8 18:41:27.205346 tst mo_mt_call_osmux.py: using CellId 22958 18:41:27.321671 tst mo_mt_call_osmux.py: using BVCI 22959 18:41:27.429613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:27.440324 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:27.450875 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:27.461440 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:27.471933 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:41:27.482627 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:41:27.594425 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:41:27.713272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:28.212294 run create_hlr_db(pid=2161): Launched 18:41:28.335032 bus /sierra_2: Setting Powered False 18:41:29.398431 run create_hlr_db(pid=2161): Terminated: ok {rc=0} 18:41:29.825350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2163): Launched 18:41:30.125296 run osmo-hlr_10.42.42.2(pid=2164): Launched 18:41:30.238951 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:30.753494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2166): Launched 18:41:31.097513 run osmo-stp_10.42.42.5(pid=2167): Launched 18:41:31.335595 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:32.049931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2169): Launched 18:41:32.353656 run osmo-msc_10.42.42.6(pid=2170): Launched 18:41:32.519446 run osmo-stp_10.42.42.5(pid=2167): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2167)] 18:41:32.644385 run osmo-stp_10.42.42.5(pid=2167): stdout: | (launched: 2022-12-09_18:41:31.034396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:32.770608 run osmo-stp_10.42.42.5(pid=2167): stderr: | [0;m[38;5;43m20221209184131371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184131371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184131372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184131372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184131374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184131375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184131375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:32.894046 run osmo-stp_10.42.42.5(pid=2167): stdout: | (launched: 2022-12-09_18:41:31.034396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:33.013261 run osmo-stp_10.42.42.5(pid=2167): stderr: | [0;m[38;5;43m20221209184131371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184131371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184131372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184131372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184131374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184131375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184131375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:33.155618 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2167): Process ended prematurely: osmo-stp_10.42.42.5(pid=2167) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2167)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:41:33.164461 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:41:33.190212 run osmo-hlr_10.42.42.2(pid=2164): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2164)] 18:41:33.236802 run osmo-hlr_10.42.42.2(pid=2164): stdout: | (launched: 2022-12-09_18:41:30.070084) 18:41:33.285188 run osmo-hlr_10.42.42.2(pid=2164): stderr: | [0;m[1;31m20221209184130247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184130247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184130248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184130248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184130248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184130248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184130260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184130269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184130269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184130269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:33.352216 run osmo-msc_10.42.42.6(pid=2170): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2170)] 18:41:33.398810 run osmo-msc_10.42.42.6(pid=2170): stdout: | (launched: 2022-12-09_18:41:32.297728) 18:41:33.447030 run osmo-msc_10.42.42.6(pid=2170): stderr: | [0;m[38;5;43m20221209184132571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184132571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb78a574c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184132571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184132571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184132571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184132571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184132573 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184132574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184132574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184132574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:33.495448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2163): Terminating (SIGTERM) 18:41:33.534105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2166): Terminating (SIGTERM) 18:41:33.572886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2169): Terminating (SIGTERM) 18:41:33.611688 --- ParallelTerminationStrategy: PID 2163 died... 18:41:33.630231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2163): Terminated: ok {rc=0} 18:41:33.673069 --- ParallelTerminationStrategy: PID 2166 died... 18:41:33.691618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2166): Terminated: ok {rc=0} 18:41:33.734230 --- ParallelTerminationStrategy: PID 2169 died... 18:41:33.752183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2169): Terminated: ok {rc=0} 18:41:33.835534 bus /sierra_3: Setting Powered False 18:41:34.933584 bus /sierra_3: Setting Powered False 18:41:36.047497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:41:37.279872 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:37.286681 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:41:37.307857 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:41:37.335014 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:41:37.386705 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:41:37.407687 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:41:37.434794 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:41:37.986601 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:41:38.038083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.049325 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:41:38.110586 tst mo_mt_call.py: using LAC 22959 18:41:38.234941 tst mo_mt_call.py: using RAC 9 18:41:38.360138 tst mo_mt_call.py: using CellId 22959 18:41:38.483616 tst mo_mt_call.py: using BVCI 22960 18:41:38.599686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.611013 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.622136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.633438 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.644630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:38.656021 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:41:38.770291 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:41:38.886280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:39.384409 run create_hlr_db(pid=2175): Launched 18:41:39.505774 bus /sierra_2: Setting Powered False 18:41:40.569744 run create_hlr_db(pid=2175): Terminated: ok {rc=0} 18:41:40.997659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Launched 18:41:41.297516 run osmo-hlr_10.42.42.2(pid=2178): Launched 18:41:41.411028 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:41.942252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Launched 18:41:42.240621 run osmo-stp_10.42.42.5(pid=2181): Launched 18:41:42.354023 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:42.894399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2183): Launched 18:41:43.192359 run osmo-msc_10.42.42.6(pid=2184): Launched 18:41:43.359925 run osmo-stp_10.42.42.5(pid=2181): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] 18:41:43.486264 run osmo-stp_10.42.42.5(pid=2181): stdout: | (launched: 2022-12-09_18:41:42.185423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:43.612330 run osmo-stp_10.42.42.5(pid=2181): stderr: | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184142361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:43.736791 run osmo-stp_10.42.42.5(pid=2181): stdout: | (launched: 2022-12-09_18:41:42.185423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:43.855568 run osmo-stp_10.42.42.5(pid=2181): stderr: | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184142360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184142361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184142361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:43.997847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2181): Process ended prematurely: osmo-stp_10.42.42.5(pid=2181) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:41:44.006418 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:41:44.032006 run osmo-hlr_10.42.42.2(pid=2178): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2178)] 18:41:44.078938 run osmo-hlr_10.42.42.2(pid=2178): stdout: | (launched: 2022-12-09_18:41:41.242314) 18:41:44.127297 run osmo-hlr_10.42.42.2(pid=2178): stderr: | [0;m[1;31m20221209184141419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184141419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184141419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184141419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184141419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184141420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184141432 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184141441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184141441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184141441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:44.194449 run osmo-msc_10.42.42.6(pid=2184): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2184)] 18:41:44.242460 run osmo-msc_10.42.42.6(pid=2184): stdout: | (launched: 2022-12-09_18:41:43.137422) 18:41:44.290651 run osmo-msc_10.42.42.6(pid=2184): stderr: | [0;m[38;5;43m20221209184143408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184143408 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7befaf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184143408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184143408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184143408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184143409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184143411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184143412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184143412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184143412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:44.339414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminating (SIGTERM) 18:41:44.378596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Terminating (SIGTERM) 18:41:44.417477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2183): Terminating (SIGTERM) 18:41:44.457079 --- ParallelTerminationStrategy: PID 2177 died... 18:41:44.475681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminated: ok {rc=0} 18:41:44.518529 --- ParallelTerminationStrategy: PID 2180 died... 18:41:44.536313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Terminated: ok {rc=0} 18:41:44.579361 --- ParallelTerminationStrategy: PID 2183 died... 18:41:44.597440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2183): Terminated: ok {rc=0} 18:41:44.681432 bus /sierra_3: Setting Powered False 18:41:45.778620 bus /sierra_3: Setting Powered False 18:41:46.903382 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:41:48.050889 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.062188 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:41:48.117390 tst mo_mt_call_osmux.py: using LAC 22960 18:41:48.233427 tst mo_mt_call_osmux.py: using RAC 10 18:41:48.349738 tst mo_mt_call_osmux.py: using CellId 22960 18:41:48.467322 tst mo_mt_call_osmux.py: using BVCI 22961 18:41:48.576480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.587370 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.598122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.608650 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.619563 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:41:48.630204 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:41:48.744217 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:41:48.862477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:49.325616 run create_hlr_db(pid=2186): Launched 18:41:49.446341 bus /sierra_2: Setting Powered False 18:41:50.506027 run create_hlr_db(pid=2186): Terminated: ok {rc=0} 18:41:50.922987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Launched 18:41:51.220537 run osmo-hlr_10.42.42.2(pid=2189): Launched 18:41:51.333914 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:51.845768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Launched 18:41:52.143380 run osmo-stp_10.42.42.5(pid=2192): Launched 18:41:52.256342 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:52.795846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2194): Launched 18:41:53.093343 run osmo-msc_10.42.42.6(pid=2195): Launched 18:41:53.258790 run osmo-stp_10.42.42.5(pid=2192): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] 18:41:53.385240 run osmo-stp_10.42.42.5(pid=2192): stdout: | (launched: 2022-12-09_18:41:52.088374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:53.510809 run osmo-stp_10.42.42.5(pid=2192): stderr: | [0;m[38;5;43m20221209184152257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184152257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184152258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184152258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:53.634305 run osmo-stp_10.42.42.5(pid=2192): stdout: | (launched: 2022-12-09_18:41:52.088374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:53.752568 run osmo-stp_10.42.42.5(pid=2192): stderr: | [0;m[38;5;43m20221209184152257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184152257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184152258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184152258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184152260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:53.894454 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2192): Process ended prematurely: osmo-stp_10.42.42.5(pid=2192) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:41:53.903016 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 18:41:53.928358 run osmo-hlr_10.42.42.2(pid=2189): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2189)] 18:41:53.974875 run osmo-hlr_10.42.42.2(pid=2189): stdout: | (launched: 2022-12-09_18:41:51.165647) 18:41:54.022546 run osmo-hlr_10.42.42.2(pid=2189): stderr: | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184151341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184151354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184151363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184151363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184151363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:54.088865 run osmo-msc_10.42.42.6(pid=2195): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2195)] 18:41:54.134964 run osmo-msc_10.42.42.6(pid=2195): stdout: | (launched: 2022-12-09_18:41:53.038273) 18:41:54.182682 run osmo-msc_10.42.42.6(pid=2195): stderr: | [0;m[38;5;43m20221209184153312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184153312 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f246208dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184153312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184153312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184153312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184153313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184153314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184153315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184153315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184153315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:54.230551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Terminating (SIGTERM) 18:41:54.268600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Terminating (SIGTERM) 18:41:54.306711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2194): Terminating (SIGTERM) 18:41:54.345078 --- ParallelTerminationStrategy: PID 2188 died... 18:41:54.363275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Terminated: ok {rc=0} 18:41:54.405608 --- ParallelTerminationStrategy: PID 2191 died... 18:41:54.423431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Terminated: ok {rc=0} 18:41:54.465605 --- ParallelTerminationStrategy: PID 2194 died... 18:41:54.483800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2194): Terminated: ok {rc=0} 18:41:54.565051 bus /sierra_3: Setting Powered False 18:41:55.660185 bus /sierra_3: Setting Powered False 18:41:56.775103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:41:57.999107 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:58.005230 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:41:58.025331 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:41:58.051010 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:41:58.103232 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:41:58.124737 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:41:58.151948 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:41:58.700325 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:41:58.753231 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:58.764710 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:41:58.822091 tst mo_mt_call.py: using LAC 22961 18:41:58.946193 tst mo_mt_call.py: using RAC 11 18:41:59.065206 tst mo_mt_call.py: using CellId 22961 18:41:59.182631 tst mo_mt_call.py: using BVCI 22962 18:41:59.300693 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:59.312355 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:59.323654 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:59.335267 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:59.347414 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:41:59.359507 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:41:59.477919 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:41:59.597533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:00.092710 run create_hlr_db(pid=2202): Launched 18:42:00.214734 bus /sierra_2: Setting Powered False 18:42:01.277453 run create_hlr_db(pid=2202): Terminated: ok {rc=0} 18:42:01.740942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2205): Launched 18:42:02.107350 run osmo-hlr_10.42.42.2(pid=2206): Launched 18:42:02.253939 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:02.770693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2208): Launched 18:42:03.067377 run osmo-stp_10.42.42.5(pid=2209): Launched 18:42:03.179832 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:03.722388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2211): Launched 18:42:04.019789 run osmo-msc_10.42.42.6(pid=2212): Launched 18:42:04.185347 run osmo-stp_10.42.42.5(pid=2209): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2209)] 18:42:04.310755 run osmo-stp_10.42.42.5(pid=2209): stdout: | (launched: 2022-12-09_18:42:03.012490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:04.436671 run osmo-stp_10.42.42.5(pid=2209): stderr: | [0;m[38;5;43m20221209184203182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184203182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184203183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184203183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:04.560238 run osmo-stp_10.42.42.5(pid=2209): stdout: | (launched: 2022-12-09_18:42:03.012490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:04.678618 run osmo-stp_10.42.42.5(pid=2209): stderr: | [0;m[38;5;43m20221209184203182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184203182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184203183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184203183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184203184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:04.820868 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2209): Process ended prematurely: osmo-stp_10.42.42.5(pid=2209) [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2209)] [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:42:04.829542 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:42:04.855051 run osmo-hlr_10.42.42.2(pid=2206): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2206)] 18:42:04.901064 run osmo-hlr_10.42.42.2(pid=2206): stdout: | (launched: 2022-12-09_18:42:02.044480) 18:42:04.948594 run osmo-hlr_10.42.42.2(pid=2206): stderr: | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184202302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184202315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184202325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184202325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184202325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:05.015196 run osmo-msc_10.42.42.6(pid=2212): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2212)] 18:42:05.061254 run osmo-msc_10.42.42.6(pid=2212): stdout: | (launched: 2022-12-09_18:42:03.965106) 18:42:05.108874 run osmo-msc_10.42.42.6(pid=2212): stderr: | [0;m[38;5;43m20221209184204237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184204237 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f39019f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184204237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184204237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184204237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184204238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184204240 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184204241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184204241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184204241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:05.156820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2205): Terminating (SIGTERM) 18:42:05.195100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2208): Terminating (SIGTERM) 18:42:05.233318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2211): Terminating (SIGTERM) 18:42:05.271621 --- ParallelTerminationStrategy: PID 2205 died... 18:42:05.289995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2205): Terminated: ok {rc=0} 18:42:05.332400 --- ParallelTerminationStrategy: PID 2208 died... 18:42:05.350253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2208): Terminated: ok {rc=0} 18:42:05.393190 --- ParallelTerminationStrategy: PID 2211 died... 18:42:05.411277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2211): Terminated: ok {rc=0} 18:42:05.495182 bus /sierra_3: Setting Powered False 18:42:06.592781 bus /sierra_3: Setting Powered False 18:42:07.705103 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:42:08.848818 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:08.860191 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:42:08.915298 tst mo_mt_call_osmux.py: using LAC 22962 18:42:09.033998 tst mo_mt_call_osmux.py: using RAC 12 18:42:09.152462 tst mo_mt_call_osmux.py: using CellId 22962 18:42:09.278564 tst mo_mt_call_osmux.py: using BVCI 22963 18:42:09.395222 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:09.406760 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:09.418237 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:09.429958 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:09.441750 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:42:09.453481 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:42:09.569523 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:42:09.689107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:10.186334 run create_hlr_db(pid=2214): Launched 18:42:10.307343 bus /sierra_2: Setting Powered False 18:42:11.370163 run create_hlr_db(pid=2214): Terminated: ok {rc=0} 18:42:11.798043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Launched 18:42:12.095774 run osmo-hlr_10.42.42.2(pid=2217): Launched 18:42:12.208470 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:12.721331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Launched 18:42:13.018801 run osmo-stp_10.42.42.5(pid=2220): Launched 18:42:13.131744 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:13.670755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2222): Launched 18:42:13.967463 run osmo-msc_10.42.42.6(pid=2223): Launched 18:42:14.132653 run osmo-stp_10.42.42.5(pid=2220): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] 18:42:14.258213 run osmo-stp_10.42.42.5(pid=2220): stdout: | (launched: 2022-12-09_18:42:12.964104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:14.384435 run osmo-stp_10.42.42.5(pid=2220): stderr: | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184213134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:14.508256 run osmo-stp_10.42.42.5(pid=2220): stdout: | (launched: 2022-12-09_18:42:12.964104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:14.626466 run osmo-stp_10.42.42.5(pid=2220): stderr: | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184213133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184213134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184213134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:14.768184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2220): Process ended prematurely: osmo-stp_10.42.42.5(pid=2220) [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:42:14.776917 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:42:14.802522 run osmo-hlr_10.42.42.2(pid=2217): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2217)] 18:42:14.849099 run osmo-hlr_10.42.42.2(pid=2217): stdout: | (launched: 2022-12-09_18:42:12.040727) 18:42:14.897215 run osmo-hlr_10.42.42.2(pid=2217): stderr: | [0;m[1;31m20221209184212217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184212217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184212217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184212217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184212217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184212218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184212230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184212238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184212238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184212239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:14.964650 run osmo-msc_10.42.42.6(pid=2223): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2223)] 18:42:15.011168 run osmo-msc_10.42.42.6(pid=2223): stdout: | (launched: 2022-12-09_18:42:13.912798) 18:42:15.059106 run osmo-msc_10.42.42.6(pid=2223): stderr: | [0;m[38;5;43m20221209184214187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184214187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1279281c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184214187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184214187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184214187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184214187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184214189 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184214189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184214190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184214190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:15.107351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Terminating (SIGTERM) 18:42:15.145898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Terminating (SIGTERM) 18:42:15.184437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2222): Terminating (SIGTERM) 18:42:15.223271 --- ParallelTerminationStrategy: PID 2216 died... 18:42:15.241805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Terminated: ok {rc=0} 18:42:15.284585 --- ParallelTerminationStrategy: PID 2219 died... 18:42:15.303114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Terminated: ok {rc=0} 18:42:15.345769 --- ParallelTerminationStrategy: PID 2222 died... 18:42:15.363830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2222): Terminated: ok {rc=0} 18:42:15.447197 bus /sierra_3: Setting Powered False 18:42:16.546904 bus /sierra_3: Setting Powered False 18:42:17.663602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:42:18.892071 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:18.897831 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:42:18.917907 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:42:18.944028 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:42:18.995301 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:42:19.015822 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:42:19.041562 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:42:19.588634 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:42:19.636270 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:19.646905 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:42:19.706505 tst mo_mt_call.py: using LAC 22963 18:42:19.821308 tst mo_mt_call.py: using RAC 13 18:42:19.935958 tst mo_mt_call.py: using CellId 22963 18:42:20.051435 tst mo_mt_call.py: using BVCI 22964 18:42:20.160090 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:20.170765 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:20.181240 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:20.191582 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:20.201938 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:20.212299 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:42:20.323263 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:42:20.442106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:20.940102 run create_hlr_db(pid=2228): Launched 18:42:21.062335 bus /sierra_2: Setting Powered False 18:42:22.125707 run create_hlr_db(pid=2228): Terminated: ok {rc=0} 18:42:22.553388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2230): Launched 18:42:22.851681 run osmo-hlr_10.42.42.2(pid=2231): Launched 18:42:22.964639 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:23.496614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2233): Launched 18:42:23.796843 run osmo-stp_10.42.42.5(pid=2234): Launched 18:42:23.910202 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:24.451540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2236): Launched 18:42:24.751626 run osmo-msc_10.42.42.6(pid=2237): Launched 18:42:24.918703 run osmo-stp_10.42.42.5(pid=2234): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2234)] 18:42:25.044853 run osmo-stp_10.42.42.5(pid=2234): stdout: | (launched: 2022-12-09_18:42:23.741379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:25.171252 run osmo-stp_10.42.42.5(pid=2234): stderr: | [0;m[38;5;43m20221209184223910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184223910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184223911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184223911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184223913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184223913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184223914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:25.297149 run osmo-stp_10.42.42.5(pid=2234): stdout: | (launched: 2022-12-09_18:42:23.741379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:25.416206 run osmo-stp_10.42.42.5(pid=2234): stderr: | [0;m[38;5;43m20221209184223910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184223910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184223911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184223911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184223913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184223913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184223914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:25.559514 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2234): Process ended prematurely: osmo-stp_10.42.42.5(pid=2234) [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2234)] [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:42:25.568329 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:42:25.594073 run osmo-hlr_10.42.42.2(pid=2231): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2231)] 18:42:25.640709 run osmo-hlr_10.42.42.2(pid=2231): stdout: | (launched: 2022-12-09_18:42:22.796659) 18:42:25.689184 run osmo-hlr_10.42.42.2(pid=2231): stderr: | [0;m[1;31m20221209184222975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184222976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184222976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184222976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184222976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184222976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184222988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184222996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184222996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184222997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:25.756418 run osmo-msc_10.42.42.6(pid=2237): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2237)] 18:42:25.802863 run osmo-msc_10.42.42.6(pid=2237): stdout: | (launched: 2022-12-09_18:42:24.695658) 18:42:25.851098 run osmo-msc_10.42.42.6(pid=2237): stderr: | [0;m[38;5;43m20221209184224969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184224969 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59f31c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184224969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184224969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184224969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184224969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184224972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184224973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184224973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184224973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:25.899274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2230): Terminating (SIGTERM) 18:42:25.938189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2233): Terminating (SIGTERM) 18:42:25.977511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2236): Terminating (SIGTERM) 18:42:26.017028 --- ParallelTerminationStrategy: PID 2230 died... 18:42:26.035487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2230): Terminated: ok {rc=0} 18:42:26.078538 --- ParallelTerminationStrategy: PID 2233 died... 18:42:26.096578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2233): Terminated: ok {rc=0} 18:42:26.139435 --- ParallelTerminationStrategy: PID 2236 died... 18:42:26.157486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2236): Terminated: ok {rc=0} 18:42:26.242697 bus /sierra_3: Setting Powered False 18:42:27.340997 bus /sierra_3: Setting Powered False 18:42:28.454638 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:42:29.598618 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:29.609953 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:42:29.665776 tst mo_mt_call_osmux.py: using LAC 22964 18:42:29.782235 tst mo_mt_call_osmux.py: using RAC 14 18:42:29.900930 tst mo_mt_call_osmux.py: using CellId 22964 18:42:30.017392 tst mo_mt_call_osmux.py: using BVCI 22965 18:42:30.124885 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:30.135715 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:30.146148 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:30.156921 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:30.167665 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:42:30.178114 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:42:30.290674 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:42:30.408882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:30.918988 run create_hlr_db(pid=2239): Launched 18:42:31.079354 bus /sierra_2: Setting Powered False 18:42:32.147576 run create_hlr_db(pid=2239): Terminated: ok {rc=0} 18:42:32.601861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2241): Launched 18:42:32.922297 run osmo-hlr_10.42.42.2(pid=2242): Launched 18:42:33.043425 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:33.596251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2244): Launched 18:42:33.917097 run osmo-stp_10.42.42.5(pid=2245): Launched 18:42:34.038891 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:34.621882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2247): Launched 18:42:34.942193 run osmo-msc_10.42.42.6(pid=2248): Launched 18:42:35.120326 run osmo-stp_10.42.42.5(pid=2245): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2245)] 18:42:35.260158 run osmo-stp_10.42.42.5(pid=2245): stdout: | (launched: 2022-12-09_18:42:33.858659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:35.396127 run osmo-stp_10.42.42.5(pid=2245): stderr: | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184234053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:35.531186 run osmo-stp_10.42.42.5(pid=2245): stdout: | (launched: 2022-12-09_18:42:33.858659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:35.658921 run osmo-stp_10.42.42.5(pid=2245): stderr: | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184234052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184234053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184234053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:35.812457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2245): Process ended prematurely: osmo-stp_10.42.42.5(pid=2245) [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2245)] [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:42:35.821858 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:42:35.850075 run osmo-hlr_10.42.42.2(pid=2242): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2242)] 18:42:35.900706 run osmo-hlr_10.42.42.2(pid=2242): stdout: | (launched: 2022-12-09_18:42:32.863904) 18:42:35.951880 run osmo-hlr_10.42.42.2(pid=2242): stderr: | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184233062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184233074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:36.023066 run osmo-msc_10.42.42.6(pid=2248): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2248)] 18:42:36.072388 run osmo-msc_10.42.42.6(pid=2248): stdout: | (launched: 2022-12-09_18:42:34.883689) 18:42:36.123388 run osmo-msc_10.42.42.6(pid=2248): stderr: | [0;m[38;5;43m20221209184235207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184235207 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe4852d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184235207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184235207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184235207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184235207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184235209 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184235210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184235210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184235210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:36.174593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2241): Terminating (SIGTERM) 18:42:36.215618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2244): Terminating (SIGTERM) 18:42:36.256812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2247): Terminating (SIGTERM) 18:42:36.298329 --- ParallelTerminationStrategy: PID 2241 died... 18:42:36.317942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2241): Terminated: ok {rc=0} 18:42:36.363742 --- ParallelTerminationStrategy: PID 2244 died... 18:42:36.382880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2244): Terminated: ok {rc=0} 18:42:36.428350 --- ParallelTerminationStrategy: PID 2247 died... 18:42:36.447499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2247): Terminated: ok {rc=0} 18:42:36.534745 bus /sierra_3: Setting Powered False 18:42:37.632723 bus /sierra_3: Setting Powered False 18:42:38.749652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:sysmo --------------------------------------------------------------------- 18:42:39.984117 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:39.988530 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 18:42:40.010087 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 18:42:40.037304 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 18:42:40.120085 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 18:42:40.141102 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 18:42:40.167824 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 18:42:40.753859 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 18:42:40.758941 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:40.770326 tst emergency:sysmo: Using 1 x bts (candidates: 1) 18:42:40.806841 tst emergency_mo_mt_call.py: using LAC 22965 18:42:40.929315 tst emergency_mo_mt_call.py: using RAC 15 18:42:41.054196 tst emergency_mo_mt_call.py: using CellId 22965 18:42:41.175489 tst emergency_mo_mt_call.py: using BVCI 22966 18:42:41.291242 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:41.302233 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:41.312917 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:41.323927 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:41.334895 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:41.345825 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:41.459503 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:41.572258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:42.030224 run create_hlr_db(pid=2253): Launched 18:42:42.151502 bus /sierra_2: Setting Powered False 18:42:43.210760 run create_hlr_db(pid=2253): Terminated: ok {rc=0} 18:42:43.644792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Launched 18:42:43.961619 run osmo-hlr_10.42.42.2(pid=2256): Launched 18:42:44.082583 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:44.628295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2258): Launched 18:42:44.926413 run osmo-stp_10.42.42.5(pid=2259): Launched 18:42:45.047254 tst emergency_mo_mt_call.py: using MSISDN 7327 18:42:45.196339 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:45.724824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2261): Launched 18:42:46.041659 run osmo-msc_10.42.42.6(pid=2262): Launched 18:42:46.448497 run osmo-stp_10.42.42.5(pid=2259): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2259)] 18:42:46.599043 run osmo-stp_10.42.42.5(pid=2259): stdout: | (launched: 2022-12-09_18:42:44.872536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:46.767733 run osmo-stp_10.42.42.5(pid=2259): stderr: | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184245044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:46.891761 run osmo-stp_10.42.42.5(pid=2259): stdout: | (launched: 2022-12-09_18:42:44.872536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:47.010515 run osmo-stp_10.42.42.5(pid=2259): stderr: | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184245043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184245044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184245044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:47.152272 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2259): Process ended prematurely: osmo-stp_10.42.42.5(pid=2259) [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2259)] [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py:19] 18:42:47.160697 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 18:42:47.186292 run osmo-hlr_10.42.42.2(pid=2256): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2256)] 18:42:47.233689 run osmo-hlr_10.42.42.2(pid=2256): stdout: | (launched: 2022-12-09_18:42:43.903909) 18:42:47.282107 run osmo-hlr_10.42.42.2(pid=2256): stderr: | [0;m[1;31m20221209184244101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184244101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184244101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184244101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184244101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184244102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184244114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184244122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184244122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184244122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:47.349598 run osmo-msc_10.42.42.6(pid=2262): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2262)] 18:42:47.395971 run osmo-msc_10.42.42.6(pid=2262): stdout: | (launched: 2022-12-09_18:42:45.978612) 18:42:47.443766 run osmo-msc_10.42.42.6(pid=2262): stderr: | [0;m[38;5;43m20221209184246384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184246384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e76751c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184246384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184246384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184246384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184246393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184246395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184246395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184246395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184246395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:47.491887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Terminating (SIGTERM) 18:42:47.530305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2258): Terminating (SIGTERM) 18:42:47.568810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2261): Terminating (SIGTERM) 18:42:47.607846 --- ParallelTerminationStrategy: PID 2255 died... 18:42:47.626522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Terminated: ok {rc=0} 18:42:47.669389 --- ParallelTerminationStrategy: PID 2258 died... 18:42:47.687615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2258): Terminated: ok {rc=0} 18:42:47.731358 --- ParallelTerminationStrategy: PID 2261 died... 18:42:47.749790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2261): Terminated: ok {rc=0} 18:42:47.832195 bus /sierra_3: Setting Powered False 18:42:48.924406 bus /sierra_3: Setting Powered False 18:42:50.034093 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 18:42:51.118811 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.130285 tst emergency:sysmo: Using 1 x bts (candidates: 1) 18:42:51.167100 tst emergency_preemptive_call.py: using LAC 22966 18:42:51.291737 tst emergency_preemptive_call.py: using RAC 16 18:42:51.413060 tst emergency_preemptive_call.py: using CellId 22966 18:42:51.534561 tst emergency_preemptive_call.py: using BVCI 22967 18:42:51.648531 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.659393 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.670430 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.681560 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.692373 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:42:51.703355 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:51.822578 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:51.940324 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:52.056006 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:42:52.168765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:52.625485 run create_hlr_db(pid=2264): Launched 18:42:52.746789 bus /sierra_2: Setting Powered False 18:42:53.806365 run create_hlr_db(pid=2264): Terminated: ok {rc=0} 18:42:54.217221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2266): Launched 18:42:54.511644 run osmo-hlr_10.42.42.2(pid=2267): Launched 18:42:54.622912 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:55.147392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Launched 18:42:55.441041 run osmo-stp_10.42.42.5(pid=2270): Launched 18:42:55.562379 tst emergency_preemptive_call.py: using MSISDN 7328 18:42:55.722787 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:56.288093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2272): Launched 18:42:56.603923 run osmo-msc_10.42.42.6(pid=2273): Launched 18:42:56.786923 run osmo-stp_10.42.42.5(pid=2270): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2270)] 18:42:56.919830 run osmo-stp_10.42.42.5(pid=2270): stdout: | (launched: 2022-12-09_18:42:55.386636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:57.053784 run osmo-stp_10.42.42.5(pid=2270): stderr: | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184255559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:57.186504 run osmo-stp_10.42.42.5(pid=2270): stdout: | (launched: 2022-12-09_18:42:55.386636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:57.312541 run osmo-stp_10.42.42.5(pid=2270): stderr: | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184255558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184255559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184255560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:57.463107 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2270): Process ended prematurely: osmo-stp_10.42.42.5(pid=2270) [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2270)] [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py:32] 18:42:57.471696 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 18:42:57.498739 run osmo-hlr_10.42.42.2(pid=2267): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2267)] 18:42:57.547883 run osmo-hlr_10.42.42.2(pid=2267): stdout: | (launched: 2022-12-09_18:42:54.457450) 18:42:57.598568 run osmo-hlr_10.42.42.2(pid=2267): stderr: | [0;m[1;31m20221209184254634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184254634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184254634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184254634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184254634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184254635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184254648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184254658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184254658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184254658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:57.668710 run osmo-msc_10.42.42.6(pid=2273): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2273)] 18:42:57.717340 run osmo-msc_10.42.42.6(pid=2273): stdout: | (launched: 2022-12-09_18:42:56.545896) 18:42:57.767840 run osmo-msc_10.42.42.6(pid=2273): stderr: | [0;m[38;5;43m20221209184256867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184256867 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf82982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184256867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184256867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184256867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184256867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184256869 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:57.818833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2266): Terminating (SIGTERM) 18:42:57.859572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Terminating (SIGTERM) 18:42:57.900252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2272): Terminating (SIGTERM) 18:42:57.941152 --- ParallelTerminationStrategy: PID 2266 died... 18:42:57.960460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2266): Terminated: ok {rc=0} 18:42:58.005945 --- ParallelTerminationStrategy: PID 2269 died... 18:42:58.024623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Terminated: ok {rc=0} 18:42:58.070155 --- ParallelTerminationStrategy: PID 2272 died... 18:42:58.089245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2272): Terminated: ok {rc=0} 18:42:58.175120 bus /sierra_9: Setting Powered False 18:42:59.271520 bus /sierra_9: Setting Powered False 18:43:00.384731 bus /sierra_8: Setting Powered False 18:43:01.496191 bus /sierra_8: Setting Powered False 18:43:02.610486 bus /sierra_3: Setting Powered False 18:43:03.705874 bus /sierra_3: Setting Powered False 18:43:04.822656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:sysmo --------------------------------------------------------------------- 18:43:06.078762 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:06.082833 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 18:43:06.103127 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 18:43:06.140280 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 18:43:06.223586 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 18:43:06.243879 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 18:43:06.281188 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 18:43:06.876152 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 18:43:06.930517 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:06.941581 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:43:06.978679 tst cs_paging_gprs_active.py: using LAC 22967 18:43:07.105727 tst cs_paging_gprs_active.py: using RAC 17 18:43:07.231854 tst cs_paging_gprs_active.py: using CellId 22967 18:43:07.359282 tst cs_paging_gprs_active.py: using BVCI 22968 18:43:07.477794 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.488615 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.499372 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.510315 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.520777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.531516 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.542179 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.553401 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:07.564359 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:07.677957 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:07.794925 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:43:07.998428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:08.300299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2278): Launched 18:43:08.562375 run iperf3-srv_10.42.42.10(pid=2279): Launched 18:43:08.674955 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:43:08.877241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:09.177911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2280): Launched 18:43:09.437828 run iperf3-srv_10.42.42.10(pid=2281): Launched 18:43:09.549272 tst cs_paging_gprs_active.py:38: start network... 18:43:09.750090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:10.214212 run create_hlr_db(pid=2282): Launched 18:43:10.336271 bus /sierra_2: Setting Powered False 18:43:11.396719 run create_hlr_db(pid=2282): Terminated: ok {rc=0} 18:43:11.835824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2284): Launched 18:43:12.157653 run osmo-hlr_10.42.42.2(pid=2285): Launched 18:43:12.280757 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:12.840449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2287): Launched 18:43:13.162249 run osmo-stp_10.42.42.5(pid=2288): Launched 18:43:13.285068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:43:14.837366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2290): Launched 18:43:14.959179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:43:15.230774 run patchelf(pid=2291): Launched 18:43:15.409871 run osmo-stp_10.42.42.5(pid=2288): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2288)] 18:43:15.545841 run osmo-stp_10.42.42.5(pid=2288): stdout: | (launched: 2022-12-09_18:43:13.102585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:15.683207 run osmo-stp_10.42.42.5(pid=2288): stderr: | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184313295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:15.821525 run osmo-stp_10.42.42.5(pid=2288): stdout: | (launched: 2022-12-09_18:43:13.102585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:15.980355 run osmo-stp_10.42.42.5(pid=2288): stderr: | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184313295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184313297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:16.140026 run patchelf(pid=2291): Terminating (SIGINT) 18:43:16.323456 run patchelf(pid=2291): Terminated: ok {rc=0} 18:43:16.457402 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2288): Process ended prematurely: osmo-stp_10.42.42.5(pid=2288) [trial-2363↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2288)] [trial-2363↪gprs:sysmo↪cs_paging_gprs_active.py:38] 18:43:16.467900 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 18:43:16.497285 run osmo-hlr_10.42.42.2(pid=2285): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2285)] 18:43:16.547438 run osmo-hlr_10.42.42.2(pid=2285): stdout: | (launched: 2022-12-09_18:43:12.098876) 18:43:16.599312 run osmo-hlr_10.42.42.2(pid=2285): stderr: | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184312297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184312308 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184312316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184312317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184312317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:16.651405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2278): Terminating (SIGTERM) 18:43:16.693963 run iperf3-srv_10.42.42.10(pid=2279): Terminating (SIGTERM) 18:43:16.738569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2280): Terminating (SIGTERM) 18:43:16.781596 run iperf3-srv_10.42.42.10(pid=2281): Terminating (SIGTERM) 18:43:16.826832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2284): Terminating (SIGTERM) 18:43:16.869959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2287): Terminating (SIGTERM) 18:43:16.913540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2290): Terminating (SIGTERM) 18:43:16.956123 --- ParallelTerminationStrategy: PID 2278 died... 18:43:16.976059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2278): Terminated: ok {rc=0} 18:43:17.022989 --- ParallelTerminationStrategy: PID 2279 died... 18:43:17.042679 run iperf3-srv_10.42.42.10(pid=2279): Terminated {rc=256} 18:43:17.089199 --- ParallelTerminationStrategy: PID 2280 died... 18:43:17.108924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2280): Terminated: ok {rc=0} 18:43:17.155580 --- ParallelTerminationStrategy: PID 2281 died... 18:43:17.175840 run iperf3-srv_10.42.42.10(pid=2281): Terminated {rc=256} 18:43:17.221706 --- ParallelTerminationStrategy: PID 2284 died... 18:43:17.240721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2284): Terminated: ok {rc=0} 18:43:17.286169 --- ParallelTerminationStrategy: PID 2287 died... 18:43:17.305271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2287): Terminated: ok {rc=0} 18:43:17.351469 --- ParallelTerminationStrategy: PID 2290 died... 18:43:17.370783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2290): Terminated: ok {rc=0} 18:43:17.457975 bus /gobi_0: Setting Powered False 18:43:18.555460 bus /gobi_0: Setting Powered False 18:43:19.669864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo iperf3.py ---------------------------------------------- 18:43:20.818760 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:20.830021 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:43:20.866460 tst iperf3.py: using LAC 22968 18:43:20.993366 tst iperf3.py: using RAC 18 18:43:21.120049 tst iperf3.py: using CellId 22968 18:43:21.244700 tst iperf3.py: using BVCI 22969 18:43:21.361315 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.372044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.382797 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.393662 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.404360 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.415171 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.426085 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.436882 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:21.447874 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:21.566269 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:43:21.784180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:22.107347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2292): Launched 18:43:22.385660 run iperf3-srv_10.42.42.10(pid=2293): Launched 18:43:22.505419 tst iperf3.py:8: start network... 18:43:22.721809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:23.218396 run create_hlr_db(pid=2294): Launched 18:43:23.339331 bus /gobi_6: Setting Powered False 18:43:24.402138 run create_hlr_db(pid=2294): Terminated: ok {rc=0} 18:43:24.829729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2296): Launched 18:43:25.127562 run osmo-hlr_10.42.42.2(pid=2297): Launched 18:43:25.240879 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:25.769563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2299): Launched 18:43:26.067511 run osmo-stp_10.42.42.5(pid=2300): Launched 18:43:26.180560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:43:26.697012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2302): Launched 18:43:26.811287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:43:27.064435 run patchelf(pid=2303): Launched 18:43:27.229899 run osmo-stp_10.42.42.5(pid=2300): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2300)] 18:43:27.355907 run osmo-stp_10.42.42.5(pid=2300): stdout: | (launched: 2022-12-09_18:43:26.012034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:27.483672 run osmo-stp_10.42.42.5(pid=2300): stderr: | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184326184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184326185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:27.611553 run osmo-stp_10.42.42.5(pid=2300): stdout: | (launched: 2022-12-09_18:43:26.012034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:27.733683 run osmo-stp_10.42.42.5(pid=2300): stderr: | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184326183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184326184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184326185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:27.878483 run patchelf(pid=2303): Terminating (SIGINT) 18:43:28.045883 run patchelf(pid=2303): Terminated: ok {rc=0} 18:43:28.166699 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2300): Process ended prematurely: osmo-stp_10.42.42.5(pid=2300) [trial-2363↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2300)] [trial-2363↪gprs:sysmo↪iperf3.py:8] 18:43:28.175913 tst iperf3.py:8: Test FAILED (7.4 sec) 18:43:28.202492 run osmo-hlr_10.42.42.2(pid=2297): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2297)] 18:43:28.249033 run osmo-hlr_10.42.42.2(pid=2297): stdout: | (launched: 2022-12-09_18:43:25.072560) 18:43:28.297302 run osmo-hlr_10.42.42.2(pid=2297): stderr: | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184325252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184325265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184325273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184325273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184325274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:28.346179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2292): Terminating (SIGTERM) 18:43:28.385019 run iperf3-srv_10.42.42.10(pid=2293): Terminating (SIGTERM) 18:43:28.423776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2296): Terminating (SIGTERM) 18:43:28.462930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2299): Terminating (SIGTERM) 18:43:28.501746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2302): Terminating (SIGTERM) 18:43:28.540740 --- ParallelTerminationStrategy: PID 2292 died... 18:43:28.559476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2292): Terminated: ok {rc=0} 18:43:28.603148 --- ParallelTerminationStrategy: PID 2293 died... 18:43:28.621561 run iperf3-srv_10.42.42.10(pid=2293): Terminated {rc=256} 18:43:28.664518 --- ParallelTerminationStrategy: PID 2296 died... 18:43:28.682733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2296): Terminated: ok {rc=0} 18:43:28.725574 --- ParallelTerminationStrategy: PID 2299 died... 18:43:28.743801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2299): Terminated: ok {rc=0} 18:43:28.787070 --- ParallelTerminationStrategy: PID 2302 died... 18:43:28.805412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2302): Terminated: ok {rc=0} 18:43:28.889152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo iperf3m4.py ---------------------------------------------- 18:43:30.035194 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.046430 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:43:30.082662 tst iperf3m4.py: using LAC 22969 18:43:30.200289 tst iperf3m4.py: using RAC 19 18:43:30.328028 tst iperf3m4.py: using CellId 22969 18:43:30.458468 tst iperf3m4.py: using BVCI 22970 18:43:30.576895 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.588051 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.598978 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.610701 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.622228 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.633942 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.645739 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.657482 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:30.669293 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:30.791032 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:30.923839 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:31.048502 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:31.195705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:43:31.403091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:31.729962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2304): Launched 18:43:32.031259 run iperf3-srv_10.42.42.10(pid=2305): Launched 18:43:32.154591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:43:32.378255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:32.701505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2306): Launched 18:43:32.980705 run iperf3-srv_10.42.42.10(pid=2307): Launched 18:43:33.100764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:43:33.317880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:33.640150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2308): Launched 18:43:33.918990 run iperf3-srv_10.42.42.10(pid=2309): Launched 18:43:34.038807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:43:34.255699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:43:34.577842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2310): Launched 18:43:34.872921 run iperf3-srv_10.42.42.10(pid=2311): Launched 18:43:34.985240 tst iperf3m4.py:8: start network... 18:43:35.185418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:35.649099 run create_hlr_db(pid=2312): Launched 18:43:35.771195 bus /gobi_6: Setting Powered False 18:43:36.831014 run create_hlr_db(pid=2312): Terminated: ok {rc=0} 18:43:37.269409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Launched 18:43:37.590442 run osmo-hlr_10.42.42.2(pid=2315): Launched 18:43:37.712473 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:38.267946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Launched 18:43:38.588395 run osmo-stp_10.42.42.5(pid=2318): Launched 18:43:38.710429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:43:39.263067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Launched 18:43:39.385305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:43:39.656348 run patchelf(pid=2321): Launched 18:43:39.834445 run osmo-stp_10.42.42.5(pid=2318): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] 18:43:39.969913 run osmo-stp_10.42.42.5(pid=2318): stdout: | (launched: 2022-12-09_18:43:38.529732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:40.107167 run osmo-stp_10.42.42.5(pid=2318): stderr: | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184338721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:40.244798 run osmo-stp_10.42.42.5(pid=2318): stdout: | (launched: 2022-12-09_18:43:38.529732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:40.375994 run osmo-stp_10.42.42.5(pid=2318): stderr: | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184338720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184338721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184338721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:40.531781 run patchelf(pid=2321): Terminating (SIGINT) 18:43:40.710567 run patchelf(pid=2321): Terminated: ok {rc=0} 18:43:40.840294 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2318): Process ended prematurely: osmo-stp_10.42.42.5(pid=2318) [trial-2363↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] [trial-2363↪gprs:sysmo↪iperf3m4.py:8] 18:43:40.850394 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:43:40.878897 run osmo-hlr_10.42.42.2(pid=2315): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2315)] 18:43:40.928288 run osmo-hlr_10.42.42.2(pid=2315): stdout: | (launched: 2022-12-09_18:43:37.531814) 18:43:40.979142 run osmo-hlr_10.42.42.2(pid=2315): stderr: | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184337730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184337743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184337753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184337754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184337754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:41.030680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2304): Terminating (SIGTERM) 18:43:41.071505 run iperf3-srv_10.42.42.10(pid=2305): Terminating (SIGTERM) 18:43:41.112574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2306): Terminating (SIGTERM) 18:43:41.153497 run iperf3-srv_10.42.42.10(pid=2307): Terminating (SIGTERM) 18:43:41.194394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2308): Terminating (SIGTERM) 18:43:41.235219 run iperf3-srv_10.42.42.10(pid=2309): Terminating (SIGTERM) 18:43:41.275894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2310): Terminating (SIGTERM) 18:43:41.317064 run iperf3-srv_10.42.42.10(pid=2311): Terminating (SIGTERM) 18:43:41.357934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Terminating (SIGTERM) 18:43:41.398873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Terminating (SIGTERM) 18:43:41.439660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Terminating (SIGTERM) 18:43:41.480679 --- ParallelTerminationStrategy: PID 2304 died... 18:43:41.500309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2304): Terminated: ok {rc=0} 18:43:41.546507 --- ParallelTerminationStrategy: PID 2305 died... 18:43:41.565558 run iperf3-srv_10.42.42.10(pid=2305): Terminated {rc=256} 18:43:41.610716 --- ParallelTerminationStrategy: PID 2306 died... 18:43:41.629697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2306): Terminated: ok {rc=0} 18:43:41.675508 --- ParallelTerminationStrategy: PID 2307 died... 18:43:41.694714 run iperf3-srv_10.42.42.10(pid=2307): Terminated {rc=256} 18:43:41.740377 --- ParallelTerminationStrategy: PID 2308 died... 18:43:41.759619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2308): Terminated: ok {rc=0} 18:43:41.805741 --- ParallelTerminationStrategy: PID 2309 died... 18:43:41.824786 run iperf3-srv_10.42.42.10(pid=2309): Terminated {rc=256} 18:43:41.870847 --- ParallelTerminationStrategy: PID 2310 died... 18:43:41.890091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2310): Terminated: ok {rc=0} 18:43:41.935864 --- ParallelTerminationStrategy: PID 2311 died... 18:43:41.954953 run iperf3-srv_10.42.42.10(pid=2311): Terminated {rc=256} 18:43:42.000670 --- ParallelTerminationStrategy: PID 2314 died... 18:43:42.019958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Terminated: ok {rc=0} 18:43:42.065599 --- ParallelTerminationStrategy: PID 2317 died... 18:43:42.084813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Terminated: ok {rc=0} 18:43:42.130588 --- ParallelTerminationStrategy: PID 2320 died... 18:43:42.149781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Terminated: ok {rc=0} 18:43:42.237675 bus /gobi_4: Setting Powered False 18:43:43.335472 bus /gobi_4: Setting Powered False 18:43:44.450443 bus /gobi_1: Setting Powered False 18:43:45.546916 bus /gobi_1: Setting Powered False 18:43:46.669145 bus /gobi_0: Setting Powered False 18:43:47.776712 bus /gobi_0: Setting Powered False 18:43:48.890634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo ping.py ---------------------------------------------- 18:43:49.992004 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.002840 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:43:50.038708 tst ping.py: using LAC 22970 18:43:50.156792 tst ping.py: using RAC 20 18:43:50.275029 tst ping.py: using CellId 22970 18:43:50.393677 tst ping.py: using BVCI 22971 18:43:50.500376 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.510734 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.520816 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.531099 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.541188 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.551173 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.561411 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:50.571424 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:50.687895 tst ping.py:19: start network... 18:43:50.902676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:51.393386 run create_hlr_db(pid=2322): Launched 18:43:51.513611 bus /gobi_6: Setting Powered False 18:43:52.576648 run create_hlr_db(pid=2322): Terminated: ok {rc=0} 18:43:53.017101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Launched 18:43:53.332597 run osmo-hlr_10.42.42.2(pid=2325): Launched 18:43:53.453407 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:53.996442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Launched 18:43:54.311515 run osmo-stp_10.42.42.5(pid=2328): Launched 18:43:54.432305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:43:54.976547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2330): Launched 18:43:55.097362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:43:55.363888 run patchelf(pid=2331): Launched 18:43:55.528028 run osmo-stp_10.42.42.5(pid=2328): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] 18:43:55.652442 run osmo-stp_10.42.42.5(pid=2328): stdout: | (launched: 2022-12-09_18:43:54.253268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:55.778478 run osmo-stp_10.42.42.5(pid=2328): stderr: | [0;m[38;5;43m20221209184354445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184354446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:55.904280 run osmo-stp_10.42.42.5(pid=2328): stdout: | (launched: 2022-12-09_18:43:54.253268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:56.024612 run osmo-stp_10.42.42.5(pid=2328): stderr: | [0;m[38;5;43m20221209184354445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184354446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184354447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:56.167230 run patchelf(pid=2331): Terminating (SIGINT) 18:43:56.331965 run patchelf(pid=2331): Terminated: ok {rc=0} 18:43:56.450468 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2328): Process ended prematurely: osmo-stp_10.42.42.5(pid=2328) [trial-2363↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] [trial-2363↪gprs:sysmo↪ping.py:22] 18:43:56.459160 tst ping.py:22: Test FAILED (6.5 sec) 18:43:56.485499 run osmo-hlr_10.42.42.2(pid=2325): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2325)] 18:43:56.532295 run osmo-hlr_10.42.42.2(pid=2325): stdout: | (launched: 2022-12-09_18:43:53.274689) 18:43:56.580835 run osmo-hlr_10.42.42.2(pid=2325): stderr: | [0;m[1;31m20221209184353474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184353474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184353475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184353475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184353475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184353475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184353682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184353693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184353693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184353693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:56.629492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Terminating (SIGTERM) 18:43:56.668923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Terminating (SIGTERM) 18:43:56.708366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2330): Terminating (SIGTERM) 18:43:56.748139 --- ParallelTerminationStrategy: PID 2324 died... 18:43:56.767132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Terminated: ok {rc=0} 18:43:56.811005 --- ParallelTerminationStrategy: PID 2327 died... 18:43:56.829323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Terminated: ok {rc=0} 18:43:56.872795 --- ParallelTerminationStrategy: PID 2330 died... 18:43:56.891177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2330): Terminated: ok {rc=0} 18:43:56.973229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 18:43:58.055794 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.066764 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:43:58.102928 tst ping_idle_ping.py: using LAC 22971 18:43:58.229374 tst ping_idle_ping.py: using RAC 21 18:43:58.354289 tst ping_idle_ping.py: using CellId 22971 18:43:58.478569 tst ping_idle_ping.py: using BVCI 22972 18:43:58.594118 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.605123 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.615928 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.626946 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.638013 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.648872 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.659993 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:43:58.671167 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:43:58.791402 tst ping_idle_ping.py:24: start network... 18:43:58.990139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:59.447039 run create_hlr_db(pid=2332): Launched 18:43:59.567026 bus /gobi_6: Setting Powered False 18:44:00.625742 run create_hlr_db(pid=2332): Terminated: ok {rc=0} 18:44:01.066147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Launched 18:44:01.385656 run osmo-hlr_10.42.42.2(pid=2335): Launched 18:44:01.603122 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:02.277294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Launched 18:44:02.572103 run osmo-stp_10.42.42.5(pid=2338): Launched 18:44:02.683264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:03.192299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Launched 18:44:03.304486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:03.553317 run patchelf(pid=2341): Launched 18:44:03.716333 run osmo-stp_10.42.42.5(pid=2338): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] 18:44:03.840910 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-09_18:44:02.517549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:03.967102 run osmo-stp_10.42.42.5(pid=2338): stderr: | [0;m[38;5;43m20221209184402688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184402689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184402689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184402689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.093082 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-09_18:44:02.517549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:04.213660 run osmo-stp_10.42.42.5(pid=2338): stderr: | [0;m[38;5;43m20221209184402688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184402689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184402689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184402689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184402690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.357379 run patchelf(pid=2341): Terminating (SIGINT) 18:44:04.522030 run patchelf(pid=2341): Terminated: ok {rc=0} 18:44:04.640299 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2363↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] [trial-2363↪gprs:sysmo↪ping_idle_ping.py:27] 18:44:04.649091 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:44:04.674930 run osmo-hlr_10.42.42.2(pid=2335): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2335)] 18:44:04.721128 run osmo-hlr_10.42.42.2(pid=2335): stdout: | (launched: 2022-12-09_18:44:01.320476) 18:44:04.768846 run osmo-hlr_10.42.42.2(pid=2335): stderr: | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184401678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184401710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184401718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184401718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184401718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:04.817291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminating (SIGTERM) 18:44:04.856630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminating (SIGTERM) 18:44:04.895374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Terminating (SIGTERM) 18:44:04.934522 --- ParallelTerminationStrategy: PID 2334 died... 18:44:04.953139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminated: ok {rc=0} 18:44:04.996135 --- ParallelTerminationStrategy: PID 2337 died... 18:44:05.014391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminated: ok {rc=0} 18:44:05.057416 --- ParallelTerminationStrategy: PID 2340 died... 18:44:05.075660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Terminated: ok {rc=0} 18:44:05.159469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 18:44:06.449099 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:44:06.454759 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:44:06.476793 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:44:06.517697 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:44:06.605656 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:44:06.626657 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:44:06.666628 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:44:07.262800 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:44:07.315893 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.327031 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:44:07.363972 tst cs_paging_gprs_active.py: using LAC 22972 18:44:07.488786 tst cs_paging_gprs_active.py: using RAC 22 18:44:07.614409 tst cs_paging_gprs_active.py: using CellId 22972 18:44:07.736532 tst cs_paging_gprs_active.py: using BVCI 22973 18:44:07.847842 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.858720 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.869778 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.880633 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.891437 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.902450 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.913405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.924166 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:07.935246 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:08.052804 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:08.171509 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:44:08.391057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:08.714942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2345): Launched 18:44:08.995281 run iperf3-srv_10.42.42.10(pid=2346): Launched 18:44:09.116384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:44:09.334816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:09.658326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2347): Launched 18:44:09.938403 run iperf3-srv_10.42.42.10(pid=2348): Launched 18:44:10.058661 tst cs_paging_gprs_active.py:38: start network... 18:44:10.276520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:10.774863 run create_hlr_db(pid=2349): Launched 18:44:10.898315 bus /gobi_6: Setting Powered False 18:44:11.962054 run create_hlr_db(pid=2349): Terminated: ok {rc=0} 18:44:12.390786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2351): Launched 18:44:12.692095 run osmo-hlr_10.42.42.2(pid=2352): Launched 18:44:12.808096 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:13.330010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Launched 18:44:13.629460 run osmo-stp_10.42.42.5(pid=2355): Launched 18:44:13.743313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:14.260251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Launched 18:44:14.374802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:14.628239 run patchelf(pid=2358): Launched 18:44:14.793739 run osmo-stp_10.42.42.5(pid=2355): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] 18:44:14.920545 run osmo-stp_10.42.42.5(pid=2355): stdout: | (launched: 2022-12-09_18:44:13.574211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:15.048464 run osmo-stp_10.42.42.5(pid=2355): stderr: | [0;m[38;5;43m20221209184413745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184413746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184413746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184413746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.177167 run osmo-stp_10.42.42.5(pid=2355): stdout: | (launched: 2022-12-09_18:44:13.574211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:15.299613 run osmo-stp_10.42.42.5(pid=2355): stderr: | [0;m[38;5;43m20221209184413745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184413746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184413746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184413746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184413747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.445291 run patchelf(pid=2358): Terminating (SIGINT) 18:44:15.612628 run patchelf(pid=2358): Terminated: ok {rc=0} 18:44:15.733634 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2355): Process ended prematurely: osmo-stp_10.42.42.5(pid=2355) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] [trial-2363↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:44:15.742977 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:44:15.769719 run osmo-hlr_10.42.42.2(pid=2352): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2352)] 18:44:15.816329 run osmo-hlr_10.42.42.2(pid=2352): stdout: | (launched: 2022-12-09_18:44:12.636882) 18:44:15.869281 run osmo-hlr_10.42.42.2(pid=2352): stderr: | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184412815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184412826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184412834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184412835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184412835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:15.924495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2345): Terminating (SIGTERM) 18:44:15.964806 run iperf3-srv_10.42.42.10(pid=2346): Terminating (SIGTERM) 18:44:16.007569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2347): Terminating (SIGTERM) 18:44:16.048816 run iperf3-srv_10.42.42.10(pid=2348): Terminating (SIGTERM) 18:44:16.092103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2351): Terminating (SIGTERM) 18:44:16.132679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Terminating (SIGTERM) 18:44:16.174734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Terminating (SIGTERM) 18:44:16.216841 --- ParallelTerminationStrategy: PID 2345 died... 18:44:16.235768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2345): Terminated: ok {rc=0} 18:44:16.279929 --- ParallelTerminationStrategy: PID 2346 died... 18:44:16.298680 run iperf3-srv_10.42.42.10(pid=2346): Terminated {rc=256} 18:44:16.342229 --- ParallelTerminationStrategy: PID 2347 died... 18:44:16.360836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2347): Terminated: ok {rc=0} 18:44:16.404416 --- ParallelTerminationStrategy: PID 2348 died... 18:44:16.422998 run iperf3-srv_10.42.42.10(pid=2348): Terminated {rc=256} 18:44:16.467243 --- ParallelTerminationStrategy: PID 2351 died... 18:44:16.485968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2351): Terminated: ok {rc=0} 18:44:16.529658 --- ParallelTerminationStrategy: PID 2354 died... 18:44:16.548327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Terminated: ok {rc=0} 18:44:16.592629 --- ParallelTerminationStrategy: PID 2357 died... 18:44:16.611541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Terminated: ok {rc=0} 18:44:16.699501 bus /gobi_0: Setting Powered False 18:44:17.802710 bus /gobi_0: Setting Powered False 18:44:18.916761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:44:20.063698 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.075396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:44:20.116219 tst iperf3.py: using LAC 22973 18:44:20.239877 tst iperf3.py: using RAC 23 18:44:20.363452 tst iperf3.py: using CellId 22973 18:44:20.487190 tst iperf3.py: using BVCI 22974 18:44:20.605912 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.616856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.627888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.639047 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.650026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.661048 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.672589 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.683756 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:20.695071 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:20.813952 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:44:21.017016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:21.318344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2359): Launched 18:44:21.579160 run iperf3-srv_10.42.42.10(pid=2360): Launched 18:44:21.690805 tst iperf3.py:8: start network... 18:44:21.891106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:22.352478 run create_hlr_db(pid=2361): Launched 18:44:22.475348 bus /gobi_6: Setting Powered False 18:44:23.538118 run create_hlr_db(pid=2361): Terminated: ok {rc=0} 18:44:23.984918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2363): Launched 18:44:24.305020 run osmo-hlr_10.42.42.2(pid=2364): Launched 18:44:24.427648 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:24.978478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2366): Launched 18:44:25.298568 run osmo-stp_10.42.42.5(pid=2367): Launched 18:44:25.420471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:25.973160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2369): Launched 18:44:26.095334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:26.367841 run patchelf(pid=2370): Launched 18:44:26.546133 run osmo-stp_10.42.42.5(pid=2367): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2367)] 18:44:26.681789 run osmo-stp_10.42.42.5(pid=2367): stdout: | (launched: 2022-12-09_18:44:25.240273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:26.819075 run osmo-stp_10.42.42.5(pid=2367): stderr: | [0;m[38;5;43m20221209184425432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184425432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184425433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184425433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:26.956485 run osmo-stp_10.42.42.5(pid=2367): stdout: | (launched: 2022-12-09_18:44:25.240273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:27.087644 run osmo-stp_10.42.42.5(pid=2367): stderr: | [0;m[38;5;43m20221209184425432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184425432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184425433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184425433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184425434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:27.243324 run patchelf(pid=2370): Terminating (SIGINT) 18:44:27.422078 run patchelf(pid=2370): Terminated: ok {rc=0} 18:44:27.551705 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2367): Process ended prematurely: osmo-stp_10.42.42.5(pid=2367) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2367)] [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 18:44:27.561821 tst iperf3.py:8: Test FAILED (7.5 sec) 18:44:27.590123 run osmo-hlr_10.42.42.2(pid=2364): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2364)] 18:44:27.639854 run osmo-hlr_10.42.42.2(pid=2364): stdout: | (launched: 2022-12-09_18:44:24.246610) 18:44:27.691102 run osmo-hlr_10.42.42.2(pid=2364): stderr: | [0;m[1;31m20221209184424445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184424445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184424445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184424445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184424445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184424446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184424458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184424468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184424469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184424469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:27.742854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2359): Terminating (SIGTERM) 18:44:27.784367 run iperf3-srv_10.42.42.10(pid=2360): Terminating (SIGTERM) 18:44:27.826583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2363): Terminating (SIGTERM) 18:44:27.868274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2366): Terminating (SIGTERM) 18:44:27.909651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2369): Terminating (SIGTERM) 18:44:27.951101 --- ParallelTerminationStrategy: PID 2359 died... 18:44:27.970807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2359): Terminated: ok {rc=0} 18:44:28.016749 --- ParallelTerminationStrategy: PID 2360 died... 18:44:28.035974 run iperf3-srv_10.42.42.10(pid=2360): Terminated {rc=256} 18:44:28.081776 --- ParallelTerminationStrategy: PID 2363 died... 18:44:28.101116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2363): Terminated: ok {rc=0} 18:44:28.146944 --- ParallelTerminationStrategy: PID 2366 died... 18:44:28.166341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2366): Terminated: ok {rc=0} 18:44:28.212383 --- ParallelTerminationStrategy: PID 2369 died... 18:44:28.231816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2369): Terminated: ok {rc=0} 18:44:28.317846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:44:29.469308 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:29.480812 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:44:29.517391 tst iperf3m4.py: using LAC 22974 18:44:29.644939 tst iperf3m4.py: using RAC 24 18:44:29.762645 tst iperf3m4.py: using CellId 22974 18:44:29.881495 tst iperf3m4.py: using BVCI 22975 18:44:29.990272 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.001063 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.011692 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.022528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.033231 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.043729 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.054407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.064810 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:30.075397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:30.193331 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:30.311306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:30.429184 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:30.546671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:44:30.765258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:31.125736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2371): Launched 18:44:31.409578 run iperf3-srv_10.42.42.10(pid=2372): Launched 18:44:31.527125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:44:31.740807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:32.059241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2373): Launched 18:44:32.362932 run iperf3-srv_10.42.42.10(pid=2374): Launched 18:44:32.484030 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:44:32.701867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:33.026147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2375): Launched 18:44:33.305217 run iperf3-srv_10.42.42.10(pid=2376): Launched 18:44:33.425773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:44:33.642975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:33.967796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2377): Launched 18:44:34.247193 run iperf3-srv_10.42.42.10(pid=2378): Launched 18:44:34.367306 tst iperf3m4.py:8: start network... 18:44:34.584337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:35.083956 run create_hlr_db(pid=2379): Launched 18:44:35.205744 bus /gobi_6: Setting Powered False 18:44:36.269135 run create_hlr_db(pid=2379): Terminated: ok {rc=0} 18:44:36.698299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2381): Launched 18:44:36.997181 run osmo-hlr_10.42.42.2(pid=2382): Launched 18:44:37.110259 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:37.636934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2384): Launched 18:44:37.935894 run osmo-stp_10.42.42.5(pid=2385): Launched 18:44:38.048764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:38.565180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2387): Launched 18:44:38.679515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:38.931959 run patchelf(pid=2388): Launched 18:44:39.098027 run osmo-stp_10.42.42.5(pid=2385): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2385)] 18:44:39.224272 run osmo-stp_10.42.42.5(pid=2385): stdout: | (launched: 2022-12-09_18:44:37.880543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:39.352246 run osmo-stp_10.42.42.5(pid=2385): stderr: | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184438051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:39.480278 run osmo-stp_10.42.42.5(pid=2385): stdout: | (launched: 2022-12-09_18:44:37.880543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:39.602610 run osmo-stp_10.42.42.5(pid=2385): stderr: | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184438051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184438051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:39.747364 run patchelf(pid=2388): Terminating (SIGINT) 18:44:39.914889 run patchelf(pid=2388): Terminated: ok {rc=0} 18:44:40.035608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2385): Process ended prematurely: osmo-stp_10.42.42.5(pid=2385) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2385)] [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 18:44:40.045148 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:44:40.072273 run osmo-hlr_10.42.42.2(pid=2382): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2382)] 18:44:40.119135 run osmo-hlr_10.42.42.2(pid=2382): stdout: | (launched: 2022-12-09_18:44:36.942032) 18:44:40.167539 run osmo-hlr_10.42.42.2(pid=2382): stderr: | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184437120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184437132 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184437143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184437143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184437143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:40.216588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2371): Terminating (SIGTERM) 18:44:40.255688 run iperf3-srv_10.42.42.10(pid=2372): Terminating (SIGTERM) 18:44:40.294712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2373): Terminating (SIGTERM) 18:44:40.333855 run iperf3-srv_10.42.42.10(pid=2374): Terminating (SIGTERM) 18:44:40.372679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2375): Terminating (SIGTERM) 18:44:40.411714 run iperf3-srv_10.42.42.10(pid=2376): Terminating (SIGTERM) 18:44:40.450591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2377): Terminating (SIGTERM) 18:44:40.489484 run iperf3-srv_10.42.42.10(pid=2378): Terminating (SIGTERM) 18:44:40.528307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2381): Terminating (SIGTERM) 18:44:40.566986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2384): Terminating (SIGTERM) 18:44:40.605995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2387): Terminating (SIGTERM) 18:44:40.645464 --- ParallelTerminationStrategy: PID 2371 died... 18:44:40.664164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2371): Terminated: ok {rc=0} 18:44:40.707272 --- ParallelTerminationStrategy: PID 2372 died... 18:44:40.725626 run iperf3-srv_10.42.42.10(pid=2372): Terminated {rc=256} 18:44:40.768386 --- ParallelTerminationStrategy: PID 2373 died... 18:44:40.786823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2373): Terminated: ok {rc=0} 18:44:40.829622 --- ParallelTerminationStrategy: PID 2374 died... 18:44:40.847708 run iperf3-srv_10.42.42.10(pid=2374): Terminated {rc=256} 18:44:40.890316 --- ParallelTerminationStrategy: PID 2375 died... 18:44:40.908357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2375): Terminated: ok {rc=0} 18:44:40.951047 --- ParallelTerminationStrategy: PID 2376 died... 18:44:40.969253 run iperf3-srv_10.42.42.10(pid=2376): Terminated {rc=256} 18:44:41.012051 --- ParallelTerminationStrategy: PID 2377 died... 18:44:41.030318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2377): Terminated: ok {rc=0} 18:44:41.073265 --- ParallelTerminationStrategy: PID 2378 died... 18:44:41.091409 run iperf3-srv_10.42.42.10(pid=2378): Terminated {rc=256} 18:44:41.134450 --- ParallelTerminationStrategy: PID 2381 died... 18:44:41.152698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2381): Terminated: ok {rc=0} 18:44:41.195622 --- ParallelTerminationStrategy: PID 2384 died... 18:44:41.213885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2384): Terminated: ok {rc=0} 18:44:41.256838 --- ParallelTerminationStrategy: PID 2387 died... 18:44:41.275464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2387): Terminated: ok {rc=0} 18:44:41.359817 bus /gobi_4: Setting Powered False 18:44:42.457951 bus /gobi_4: Setting Powered False 18:44:43.571775 bus /gobi_1: Setting Powered False 18:44:44.669200 bus /gobi_1: Setting Powered False 18:44:45.781974 bus /gobi_0: Setting Powered False 18:44:46.882784 bus /gobi_0: Setting Powered False 18:44:48.001374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 18:44:49.103768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.114870 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:44:49.153587 tst ping.py: using LAC 22975 18:44:49.280341 tst ping.py: using RAC 25 18:44:49.411224 tst ping.py: using CellId 22975 18:44:49.534870 tst ping.py: using BVCI 22976 18:44:49.649742 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.660835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.672336 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.683852 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.695317 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.706804 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.718579 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:49.730006 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:49.850396 tst ping.py:19: start network... 18:44:50.063585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:50.552170 run create_hlr_db(pid=2389): Launched 18:44:50.672682 bus /gobi_6: Setting Powered False 18:44:51.735180 run create_hlr_db(pid=2389): Terminated: ok {rc=0} 18:44:52.176901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Launched 18:44:52.492895 run osmo-hlr_10.42.42.2(pid=2392): Launched 18:44:52.614179 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:53.124369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Launched 18:44:53.417046 run osmo-stp_10.42.42.5(pid=2395): Launched 18:44:53.527525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:54.033608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Launched 18:44:54.145220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:54.393303 run patchelf(pid=2398): Launched 18:44:54.555947 run osmo-stp_10.42.42.5(pid=2395): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] 18:44:54.679499 run osmo-stp_10.42.42.5(pid=2395): stdout: | (launched: 2022-12-09_18:44:53.362618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:54.804545 run osmo-stp_10.42.42.5(pid=2395): stderr: | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184453534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:54.929628 run osmo-stp_10.42.42.5(pid=2395): stdout: | (launched: 2022-12-09_18:44:53.362618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:55.049307 run osmo-stp_10.42.42.5(pid=2395): stderr: | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184453533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184453534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184453534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:55.191511 run patchelf(pid=2398): Terminating (SIGINT) 18:44:55.355123 run patchelf(pid=2398): Terminated: ok {rc=0} 18:44:55.473293 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2395): Process ended prematurely: osmo-stp_10.42.42.5(pid=2395) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 18:44:55.481962 tst ping.py:22: Test FAILED (6.4 sec) 18:44:55.508156 run osmo-hlr_10.42.42.2(pid=2392): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2392)] 18:44:55.555012 run osmo-hlr_10.42.42.2(pid=2392): stdout: | (launched: 2022-12-09_18:44:52.434906) 18:44:55.603288 run osmo-hlr_10.42.42.2(pid=2392): stderr: | [0;m[1;31m20221209184452630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184452630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184452631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184452631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184452631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184452631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184452643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184452651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184452651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184452651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:55.651891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Terminating (SIGTERM) 18:44:55.690752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Terminating (SIGTERM) 18:44:55.729605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Terminating (SIGTERM) 18:44:55.768672 --- ParallelTerminationStrategy: PID 2391 died... 18:44:55.787392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Terminated: ok {rc=0} 18:44:55.830696 --- ParallelTerminationStrategy: PID 2394 died... 18:44:55.848793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Terminated: ok {rc=0} 18:44:55.891976 --- ParallelTerminationStrategy: PID 2397 died... 18:44:55.910391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Terminated: ok {rc=0} 18:44:55.991846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:44:57.077563 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.089324 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:44:57.129389 tst ping_idle_ping.py: using LAC 22976 18:44:57.253390 tst ping_idle_ping.py: using RAC 26 18:44:57.377204 tst ping_idle_ping.py: using CellId 22976 18:44:57.500403 tst ping_idle_ping.py: using BVCI 22977 18:44:57.615425 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.626746 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.637775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.648782 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.660004 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.671223 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.682652 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:44:57.694282 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:44:57.819223 tst ping_idle_ping.py:24: start network... 18:44:58.033185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:58.522702 run create_hlr_db(pid=2399): Launched 18:44:58.642476 bus /gobi_6: Setting Powered False 18:44:59.705627 run create_hlr_db(pid=2399): Terminated: ok {rc=0} 18:45:00.129337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2401): Launched 18:45:00.425274 run osmo-hlr_10.42.42.2(pid=2402): Launched 18:45:00.537570 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:01.089287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2404): Launched 18:45:01.527515 run osmo-stp_10.42.42.5(pid=2405): Launched 18:45:01.665239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:02.400184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Launched 18:45:02.524635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:02.775516 run patchelf(pid=2411): Launched 18:45:02.939662 run osmo-stp_10.42.42.5(pid=2405): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2405)] 18:45:03.063887 run osmo-stp_10.42.42.5(pid=2405): stdout: | (launched: 2022-12-09_18:45:01.449126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:03.189719 run osmo-stp_10.42.42.5(pid=2405): stderr: | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184501836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:03.315226 run osmo-stp_10.42.42.5(pid=2405): stdout: | (launched: 2022-12-09_18:45:01.449126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:03.435646 run osmo-stp_10.42.42.5(pid=2405): stderr: | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184501824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184501836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184501839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:03.578254 run patchelf(pid=2411): Terminating (SIGINT) 18:45:03.742447 run patchelf(pid=2411): Terminated: ok {rc=0} 18:45:03.861250 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2405): Process ended prematurely: osmo-stp_10.42.42.5(pid=2405) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2405)] [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 18:45:03.869931 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 18:45:03.895841 run osmo-hlr_10.42.42.2(pid=2402): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2402)] 18:45:03.942844 run osmo-hlr_10.42.42.2(pid=2402): stdout: | (launched: 2022-12-09_18:45:00.370555) 18:45:03.991174 run osmo-hlr_10.42.42.2(pid=2402): stderr: | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184500544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184500557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184500566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184500566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184500566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:04.039899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2401): Terminating (SIGTERM) 18:45:04.078887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2404): Terminating (SIGTERM) 18:45:04.117853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Terminating (SIGTERM) 18:45:04.156827 --- ParallelTerminationStrategy: PID 2401 died... 18:45:04.175540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2401): Terminated: ok {rc=0} 18:45:04.218528 --- ParallelTerminationStrategy: PID 2404 died... 18:45:04.236502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2404): Terminated: ok {rc=0} 18:45:04.279332 --- ParallelTerminationStrategy: PID 2410 died... 18:45:04.297466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Terminated: ok {rc=0} 18:45:04.379239 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:45:05.665997 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:45:05.672346 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:45:05.693371 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:45:05.734641 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:45:05.822588 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:45:05.844342 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:45:05.884603 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:45:06.475418 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:45:06.528758 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:06.539969 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:45:06.598293 tst cs_paging_gprs_active.py: using LAC 22977 18:45:06.725388 tst cs_paging_gprs_active.py: using RAC 27 18:45:06.851576 tst cs_paging_gprs_active.py: using CellId 22977 18:45:06.977355 tst cs_paging_gprs_active.py: using BVCI 22978 18:45:07.095580 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.106876 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.117838 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.129788 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.141506 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.153424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.165305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.177091 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:07.189282 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:07.310428 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:07.429453 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:45:07.648004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:07.970864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Launched 18:45:08.250081 run iperf3-srv_10.42.42.10(pid=2416): Launched 18:45:08.369931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:45:08.586919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:08.909710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Launched 18:45:09.188254 run iperf3-srv_10.42.42.10(pid=2418): Launched 18:45:09.308721 tst cs_paging_gprs_active.py:38: start network... 18:45:09.526187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:10.024463 run create_hlr_db(pid=2419): Launched 18:45:10.146952 bus /gobi_6: Setting Powered False 18:45:11.210911 run create_hlr_db(pid=2419): Terminated: ok {rc=0} 18:45:11.640675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Launched 18:45:11.942540 run osmo-hlr_10.42.42.2(pid=2422): Launched 18:45:12.056655 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:12.588700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Launched 18:45:12.889131 run osmo-stp_10.42.42.5(pid=2425): Launched 18:45:13.003718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:13.520907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Launched 18:45:13.635096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:13.889446 run patchelf(pid=2428): Launched 18:45:14.055768 run osmo-stp_10.42.42.5(pid=2425): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] 18:45:14.183684 run osmo-stp_10.42.42.5(pid=2425): stdout: | (launched: 2022-12-09_18:45:12.833311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:14.311793 run osmo-stp_10.42.42.5(pid=2425): stderr: | [0;m[38;5;43m20221209184513004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184513004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184513005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184513005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:14.439983 run osmo-stp_10.42.42.5(pid=2425): stdout: | (launched: 2022-12-09_18:45:12.833311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:14.562536 run osmo-stp_10.42.42.5(pid=2425): stderr: | [0;m[38;5;43m20221209184513004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184513004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184513005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184513005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184513006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:14.708377 run patchelf(pid=2428): Terminating (SIGINT) 18:45:14.876201 run patchelf(pid=2428): Terminated: ok {rc=0} 18:45:14.998303 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2425): Process ended prematurely: osmo-stp_10.42.42.5(pid=2425) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:45:15.007580 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:45:15.034213 run osmo-hlr_10.42.42.2(pid=2422): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2422)] 18:45:15.080795 run osmo-hlr_10.42.42.2(pid=2422): stdout: | (launched: 2022-12-09_18:45:11.886659) 18:45:15.129116 run osmo-hlr_10.42.42.2(pid=2422): stderr: | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184512065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184512078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184512086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184512087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184512087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:15.177781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Terminating (SIGTERM) 18:45:15.217074 run iperf3-srv_10.42.42.10(pid=2416): Terminating (SIGTERM) 18:45:15.255901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Terminating (SIGTERM) 18:45:15.294787 run iperf3-srv_10.42.42.10(pid=2418): Terminating (SIGTERM) 18:45:15.333802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Terminating (SIGTERM) 18:45:15.372752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Terminating (SIGTERM) 18:45:15.411522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Terminating (SIGTERM) 18:45:15.450593 --- ParallelTerminationStrategy: PID 2415 died... 18:45:15.469487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Terminated: ok {rc=0} 18:45:15.513219 --- ParallelTerminationStrategy: PID 2416 died... 18:45:15.531454 run iperf3-srv_10.42.42.10(pid=2416): Terminated {rc=256} 18:45:15.574256 --- ParallelTerminationStrategy: PID 2417 died... 18:45:15.593031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Terminated: ok {rc=0} 18:45:15.635835 --- ParallelTerminationStrategy: PID 2418 died... 18:45:15.653926 run iperf3-srv_10.42.42.10(pid=2418): Terminated {rc=256} 18:45:15.696621 --- ParallelTerminationStrategy: PID 2421 died... 18:45:15.714972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Terminated: ok {rc=0} 18:45:15.763088 --- ParallelTerminationStrategy: PID 2424 died... 18:45:15.782467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Terminated: ok {rc=0} 18:45:15.833316 --- ParallelTerminationStrategy: PID 2427 died... 18:45:15.853751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Terminated: ok {rc=0} 18:45:15.946696 bus /gobi_0: Setting Powered False 18:45:17.053333 bus /gobi_0: Setting Powered False 18:45:18.180089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:45:19.328597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.340357 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:45:19.405754 tst iperf3.py: using LAC 22978 18:45:19.530781 tst iperf3.py: using RAC 28 18:45:19.654255 tst iperf3.py: using CellId 22978 18:45:19.780231 tst iperf3.py: using BVCI 22979 18:45:19.898788 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.910003 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.920789 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.932577 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.944182 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.955757 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.967526 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.979063 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:19.990819 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:20.107365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:20.325782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:20.649458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2431): Launched 18:45:20.929807 run iperf3-srv_10.42.42.10(pid=2432): Launched 18:45:21.050390 tst iperf3.py:8: start network... 18:45:21.267484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:21.765745 run create_hlr_db(pid=2433): Launched 18:45:21.887691 bus /gobi_6: Setting Powered False 18:45:22.951614 run create_hlr_db(pid=2433): Terminated: ok {rc=0} 18:45:23.398875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2435): Launched 18:45:23.719717 run osmo-hlr_10.42.42.2(pid=2436): Launched 18:45:23.842288 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:24.401298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2438): Launched 18:45:24.721687 run osmo-stp_10.42.42.5(pid=2439): Launched 18:45:24.843570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:25.398996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2441): Launched 18:45:25.523295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:25.794772 run patchelf(pid=2442): Launched 18:45:25.972940 run osmo-stp_10.42.42.5(pid=2439): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2439)] 18:45:26.109168 run osmo-stp_10.42.42.5(pid=2439): stdout: | (launched: 2022-12-09_18:45:24.663269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:26.246766 run osmo-stp_10.42.42.5(pid=2439): stderr: | [0;m[38;5;43m20221209184524855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184524856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184524856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184524856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:26.384521 run osmo-stp_10.42.42.5(pid=2439): stdout: | (launched: 2022-12-09_18:45:24.663269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:26.516074 run osmo-stp_10.42.42.5(pid=2439): stderr: | [0;m[38;5;43m20221209184524855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184524856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184524856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184524856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184524857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:26.672259 run patchelf(pid=2442): Terminating (SIGINT) 18:45:26.852337 run patchelf(pid=2442): Terminated: ok {rc=0} 18:45:26.982035 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2439): Process ended prematurely: osmo-stp_10.42.42.5(pid=2439) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2439)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 18:45:26.992386 tst iperf3.py:8: Test FAILED (7.7 sec) 18:45:27.021542 run osmo-hlr_10.42.42.2(pid=2436): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2436)] 18:45:27.071644 run osmo-hlr_10.42.42.2(pid=2436): stdout: | (launched: 2022-12-09_18:45:23.660911) 18:45:27.123173 run osmo-hlr_10.42.42.2(pid=2436): stderr: | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184523863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184523876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184523886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184523886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184523886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:27.175085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2431): Terminating (SIGTERM) 18:45:27.216815 run iperf3-srv_10.42.42.10(pid=2432): Terminating (SIGTERM) 18:45:27.258696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2435): Terminating (SIGTERM) 18:45:27.300300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2438): Terminating (SIGTERM) 18:45:27.342093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2441): Terminating (SIGTERM) 18:45:27.383997 --- ParallelTerminationStrategy: PID 2431 died... 18:45:27.403921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2431): Terminated: ok {rc=0} 18:45:27.450443 --- ParallelTerminationStrategy: PID 2432 died... 18:45:27.469854 run iperf3-srv_10.42.42.10(pid=2432): Terminated {rc=256} 18:45:27.516376 --- ParallelTerminationStrategy: PID 2435 died... 18:45:27.535855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2435): Terminated: ok {rc=0} 18:45:27.581915 --- ParallelTerminationStrategy: PID 2438 died... 18:45:27.600987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2438): Terminated: ok {rc=0} 18:45:27.646563 --- ParallelTerminationStrategy: PID 2441 died... 18:45:27.665713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2441): Terminated: ok {rc=0} 18:45:27.753099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:45:28.903279 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:28.914946 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:45:28.971456 tst iperf3m4.py: using LAC 22979 18:45:29.098713 tst iperf3m4.py: using RAC 29 18:45:29.225271 tst iperf3m4.py: using CellId 22979 18:45:29.351828 tst iperf3m4.py: using BVCI 22980 18:45:29.467828 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.479019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.490027 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.501186 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.512325 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.523531 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.534856 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.546106 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:29.557500 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:29.675986 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:29.794363 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:29.908221 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:30.025544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:30.244327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:30.568768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2443): Launched 18:45:30.852015 run iperf3-srv_10.42.42.10(pid=2444): Launched 18:45:30.988906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:45:31.195620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:31.515636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2445): Launched 18:45:31.809652 run iperf3-srv_10.42.42.10(pid=2446): Launched 18:45:31.928740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:45:32.134839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:32.439014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2447): Launched 18:45:32.698938 run iperf3-srv_10.42.42.10(pid=2448): Launched 18:45:32.810151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:45:33.010263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:33.310578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2449): Launched 18:45:33.570711 run iperf3-srv_10.42.42.10(pid=2450): Launched 18:45:33.682029 tst iperf3m4.py:8: start network... 18:45:33.882437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:34.346345 run create_hlr_db(pid=2451): Launched 18:45:34.468645 bus /gobi_6: Setting Powered False 18:45:35.528832 run create_hlr_db(pid=2451): Terminated: ok {rc=0} 18:45:35.946267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2453): Launched 18:45:36.245197 run osmo-hlr_10.42.42.2(pid=2454): Launched 18:45:36.357881 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:36.876188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2456): Launched 18:45:37.174726 run osmo-stp_10.42.42.5(pid=2457): Launched 18:45:37.286823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:37.799826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2459): Launched 18:45:37.913475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:38.165768 run patchelf(pid=2460): Launched 18:45:38.346033 run osmo-stp_10.42.42.5(pid=2457): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2457)] 18:45:38.481904 run osmo-stp_10.42.42.5(pid=2457): stdout: | (launched: 2022-12-09_18:45:37.119426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:38.619321 run osmo-stp_10.42.42.5(pid=2457): stderr: | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184537287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:38.756674 run osmo-stp_10.42.42.5(pid=2457): stdout: | (launched: 2022-12-09_18:45:37.119426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:38.888834 run osmo-stp_10.42.42.5(pid=2457): stderr: | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184537287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184537287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184537288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:39.044210 run patchelf(pid=2460): Terminating (SIGINT) 18:45:39.223669 run patchelf(pid=2460): Terminated: ok {rc=0} 18:45:39.352871 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2457): Process ended prematurely: osmo-stp_10.42.42.5(pid=2457) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2457)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:45:39.362947 tst iperf3m4.py:8: Test FAILED (10.5 sec) 18:45:39.391485 run osmo-hlr_10.42.42.2(pid=2454): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2454)] 18:45:39.441355 run osmo-hlr_10.42.42.2(pid=2454): stdout: | (launched: 2022-12-09_18:45:36.189734) 18:45:39.492152 run osmo-hlr_10.42.42.2(pid=2454): stderr: | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184536366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184536379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184536388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184536388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184536388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:39.543251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2443): Terminating (SIGTERM) 18:45:39.584179 run iperf3-srv_10.42.42.10(pid=2444): Terminating (SIGTERM) 18:45:39.625090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2445): Terminating (SIGTERM) 18:45:39.666131 run iperf3-srv_10.42.42.10(pid=2446): Terminating (SIGTERM) 18:45:39.706950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2447): Terminating (SIGTERM) 18:45:39.747896 run iperf3-srv_10.42.42.10(pid=2448): Terminating (SIGTERM) 18:45:39.788707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2449): Terminating (SIGTERM) 18:45:39.829614 run iperf3-srv_10.42.42.10(pid=2450): Terminating (SIGTERM) 18:45:39.870769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2453): Terminating (SIGTERM) 18:45:39.911729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2456): Terminating (SIGTERM) 18:45:39.952539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2459): Terminating (SIGTERM) 18:45:39.993818 --- ParallelTerminationStrategy: PID 2443 died... 18:45:40.013416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2443): Terminated: ok {rc=0} 18:45:40.059239 --- ParallelTerminationStrategy: PID 2444 died... 18:45:40.078356 run iperf3-srv_10.42.42.10(pid=2444): Terminated {rc=256} 18:45:40.123773 --- ParallelTerminationStrategy: PID 2445 died... 18:45:40.142812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2445): Terminated: ok {rc=0} 18:45:40.188620 --- ParallelTerminationStrategy: PID 2446 died... 18:45:40.207829 run iperf3-srv_10.42.42.10(pid=2446): Terminated {rc=256} 18:45:40.253173 --- ParallelTerminationStrategy: PID 2447 died... 18:45:40.272186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2447): Terminated: ok {rc=0} 18:45:40.317813 --- ParallelTerminationStrategy: PID 2448 died... 18:45:40.336894 run iperf3-srv_10.42.42.10(pid=2448): Terminated {rc=256} 18:45:40.382387 --- ParallelTerminationStrategy: PID 2449 died... 18:45:40.401605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2449): Terminated: ok {rc=0} 18:45:40.447363 --- ParallelTerminationStrategy: PID 2450 died... 18:45:40.466513 run iperf3-srv_10.42.42.10(pid=2450): Terminated {rc=256} 18:45:40.512125 --- ParallelTerminationStrategy: PID 2453 died... 18:45:40.531357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2453): Terminated: ok {rc=0} 18:45:40.577089 --- ParallelTerminationStrategy: PID 2456 died... 18:45:40.596148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2456): Terminated: ok {rc=0} 18:45:40.641978 --- ParallelTerminationStrategy: PID 2459 died... 18:45:40.661268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2459): Terminated: ok {rc=0} 18:45:40.747316 bus /gobi_4: Setting Powered False 18:45:41.845613 bus /gobi_4: Setting Powered False 18:45:42.961390 bus /gobi_1: Setting Powered False 18:45:44.058705 bus /gobi_1: Setting Powered False 18:45:45.175192 bus /gobi_0: Setting Powered False 18:45:46.271461 bus /gobi_0: Setting Powered False 18:45:47.390861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:45:48.494778 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:48.506678 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:45:48.565350 tst ping.py: using LAC 22980 18:45:48.681578 tst ping.py: using RAC 30 18:45:48.796867 tst ping.py: using CellId 22980 18:45:48.925388 tst ping.py: using BVCI 22981 18:45:49.041442 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.052596 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.063625 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.074909 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.086076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.097198 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.108456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:49.119714 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:49.236510 tst ping.py:19: start network... 18:45:49.433638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:49.888743 run create_hlr_db(pid=2461): Launched 18:45:50.010782 bus /gobi_6: Setting Powered False 18:45:51.070003 run create_hlr_db(pid=2461): Terminated: ok {rc=0} 18:45:51.481474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Launched 18:45:51.776104 run osmo-hlr_10.42.42.2(pid=2464): Launched 18:45:51.898799 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:52.453567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Launched 18:45:52.769029 run osmo-stp_10.42.42.5(pid=2467): Launched 18:45:52.889863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:53.434121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2470): Launched 18:45:53.553880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:53.819383 run patchelf(pid=2471): Launched 18:45:53.994183 run osmo-stp_10.42.42.5(pid=2467): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] 18:45:54.126871 run osmo-stp_10.42.42.5(pid=2467): stdout: | (launched: 2022-12-09_18:45:52.711330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:54.261238 run osmo-stp_10.42.42.5(pid=2467): stderr: | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184552904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:54.395998 run osmo-stp_10.42.42.5(pid=2467): stdout: | (launched: 2022-12-09_18:45:52.711330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:54.524549 run osmo-stp_10.42.42.5(pid=2467): stderr: | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184552903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184552904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:54.677389 run patchelf(pid=2471): Terminating (SIGINT) 18:45:54.852037 run patchelf(pid=2471): Terminated: ok {rc=0} 18:45:54.978599 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2467): Process ended prematurely: osmo-stp_10.42.42.5(pid=2467) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 18:45:54.987962 tst ping.py:22: Test FAILED (6.5 sec) 18:45:55.015926 run osmo-hlr_10.42.42.2(pid=2464): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2464)] 18:45:55.064631 run osmo-hlr_10.42.42.2(pid=2464): stdout: | (launched: 2022-12-09_18:45:51.721285) 18:45:55.115130 run osmo-hlr_10.42.42.2(pid=2464): stderr: | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184551914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184551930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184551938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184551938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184551938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:55.166238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Terminating (SIGTERM) 18:45:55.207020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Terminating (SIGTERM) 18:45:55.248066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2470): Terminating (SIGTERM) 18:45:55.289260 --- ParallelTerminationStrategy: PID 2463 died... 18:45:55.308746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Terminated: ok {rc=0} 18:45:55.354119 --- ParallelTerminationStrategy: PID 2466 died... 18:45:55.373193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Terminated: ok {rc=0} 18:45:55.418804 --- ParallelTerminationStrategy: PID 2470 died... 18:45:55.437924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2470): Terminated: ok {rc=0} 18:45:55.523526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:45:56.608474 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:56.619592 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:45:56.675980 tst ping_idle_ping.py: using LAC 22981 18:45:56.801360 tst ping_idle_ping.py: using RAC 31 18:45:56.925712 tst ping_idle_ping.py: using CellId 22981 18:45:57.045365 tst ping_idle_ping.py: using BVCI 22982 18:45:57.152250 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.163045 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.173635 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.184523 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.195530 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.206360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.217487 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:45:57.228681 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:45:57.345758 tst ping_idle_ping.py:24: start network... 18:45:57.559725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:58.053189 run create_hlr_db(pid=2472): Launched 18:45:58.173716 bus /gobi_6: Setting Powered False 18:45:59.236254 run create_hlr_db(pid=2472): Terminated: ok {rc=0} 18:45:59.658784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Launched 18:45:59.956098 run osmo-hlr_10.42.42.2(pid=2475): Launched 18:46:00.068541 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:00.576475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Launched 18:46:00.881992 run osmo-stp_10.42.42.5(pid=2478): Launched 18:46:01.032916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:01.705852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2480): Launched 18:46:01.822688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:02.083811 run patchelf(pid=2481): Launched 18:46:02.259386 run osmo-stp_10.42.42.5(pid=2478): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] 18:46:02.385149 run osmo-stp_10.42.42.5(pid=2478): stdout: | (launched: 2022-12-09_18:46:00.816041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:02.510748 run osmo-stp_10.42.42.5(pid=2478): stderr: | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184601188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:02.636643 run osmo-stp_10.42.42.5(pid=2478): stdout: | (launched: 2022-12-09_18:46:00.816041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:02.757517 run osmo-stp_10.42.42.5(pid=2478): stderr: | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184601188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184601188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:02.900376 run patchelf(pid=2481): Terminating (SIGINT) 18:46:03.065131 run patchelf(pid=2481): Terminated: ok {rc=0} 18:46:03.183719 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2478): Process ended prematurely: osmo-stp_10.42.42.5(pid=2478) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:46:03.192591 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:46:03.218831 run osmo-hlr_10.42.42.2(pid=2475): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2475)] 18:46:03.265337 run osmo-hlr_10.42.42.2(pid=2475): stdout: | (launched: 2022-12-09_18:45:59.901590) 18:46:03.314203 run osmo-hlr_10.42.42.2(pid=2475): stderr: | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184600079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184600092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184600100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184600100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184600100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:03.362877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Terminating (SIGTERM) 18:46:03.401324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Terminating (SIGTERM) 18:46:03.439803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2480): Terminating (SIGTERM) 18:46:03.478920 --- ParallelTerminationStrategy: PID 2474 died... 18:46:03.497634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Terminated: ok {rc=0} 18:46:03.541232 --- ParallelTerminationStrategy: PID 2477 died... 18:46:03.559417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Terminated: ok {rc=0} 18:46:03.602400 --- ParallelTerminationStrategy: PID 2480 died... 18:46:03.620630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2480): Terminated: ok {rc=0} 18:46:03.704050 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:46:04.986278 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:46:04.992463 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:46:05.013110 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:46:05.050259 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:46:05.138769 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:46:05.161677 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:46:05.201952 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:46:05.784926 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:46:05.838819 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:05.850146 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:46:05.907223 tst cs_paging_gprs_active.py: using LAC 22982 18:46:06.032562 tst cs_paging_gprs_active.py: using RAC 32 18:46:06.156154 tst cs_paging_gprs_active.py: using CellId 22982 18:46:06.279905 tst cs_paging_gprs_active.py: using BVCI 22983 18:46:06.396697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.407930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.418817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.430022 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.441110 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.452086 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.463229 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.474302 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:06.486231 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:06.601840 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:06.718970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:46:06.921157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:07.223011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2486): Launched 18:46:07.484368 run iperf3-srv_10.42.42.10(pid=2487): Launched 18:46:07.595963 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:46:07.796400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:08.097585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2488): Launched 18:46:08.358582 run iperf3-srv_10.42.42.10(pid=2489): Launched 18:46:08.470430 tst cs_paging_gprs_active.py:38: start network... 18:46:08.670793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:09.135159 run create_hlr_db(pid=2490): Launched 18:46:09.257657 bus /gobi_6: Setting Powered False 18:46:10.317986 run create_hlr_db(pid=2490): Terminated: ok {rc=0} 18:46:10.756221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2492): Launched 18:46:11.078155 run osmo-hlr_10.42.42.2(pid=2493): Launched 18:46:11.201148 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:11.758190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2495): Launched 18:46:12.080444 run osmo-stp_10.42.42.5(pid=2496): Launched 18:46:12.203129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:12.758940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2498): Launched 18:46:12.883367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:13.156538 run patchelf(pid=2499): Launched 18:46:13.334673 run osmo-stp_10.42.42.5(pid=2496): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2496)] 18:46:13.471578 run osmo-stp_10.42.42.5(pid=2496): stdout: | (launched: 2022-12-09_18:46:12.021705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:13.609630 run osmo-stp_10.42.42.5(pid=2496): stderr: | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184612217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:13.747477 run osmo-stp_10.42.42.5(pid=2496): stdout: | (launched: 2022-12-09_18:46:12.021705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:13.879913 run osmo-stp_10.42.42.5(pid=2496): stderr: | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184612216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184612217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184612217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:14.036209 run patchelf(pid=2499): Terminating (SIGINT) 18:46:14.216080 run patchelf(pid=2499): Terminated: ok {rc=0} 18:46:14.345856 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2496): Process ended prematurely: osmo-stp_10.42.42.5(pid=2496) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2496)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:46:14.355943 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:46:14.384600 run osmo-hlr_10.42.42.2(pid=2493): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2493)] 18:46:14.433675 run osmo-hlr_10.42.42.2(pid=2493): stdout: | (launched: 2022-12-09_18:46:11.019274) 18:46:14.484590 run osmo-hlr_10.42.42.2(pid=2493): stderr: | [0;m[1;31m20221209184611219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184611219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184611219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184611219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184611219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184611220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184611236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184611246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184611246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184611246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:14.535716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2486): Terminating (SIGTERM) 18:46:14.576635 run iperf3-srv_10.42.42.10(pid=2487): Terminating (SIGTERM) 18:46:14.617538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2488): Terminating (SIGTERM) 18:46:14.658639 run iperf3-srv_10.42.42.10(pid=2489): Terminating (SIGTERM) 18:46:14.699516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2492): Terminating (SIGTERM) 18:46:14.740356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2495): Terminating (SIGTERM) 18:46:14.781214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2498): Terminating (SIGTERM) 18:46:14.822562 --- ParallelTerminationStrategy: PID 2486 died... 18:46:14.842155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2486): Terminated: ok {rc=0} 18:46:14.888587 --- ParallelTerminationStrategy: PID 2487 died... 18:46:14.907556 run iperf3-srv_10.42.42.10(pid=2487): Terminated {rc=256} 18:46:14.953238 --- ParallelTerminationStrategy: PID 2488 died... 18:46:14.972334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2488): Terminated: ok {rc=0} 18:46:15.018055 --- ParallelTerminationStrategy: PID 2489 died... 18:46:15.037233 run iperf3-srv_10.42.42.10(pid=2489): Terminated {rc=256} 18:46:15.082805 --- ParallelTerminationStrategy: PID 2492 died... 18:46:15.102029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2492): Terminated: ok {rc=0} 18:46:15.147451 --- ParallelTerminationStrategy: PID 2495 died... 18:46:15.166807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2495): Terminated: ok {rc=0} 18:46:15.212351 --- ParallelTerminationStrategy: PID 2498 died... 18:46:15.231546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2498): Terminated: ok {rc=0} 18:46:15.317909 bus /gobi_0: Setting Powered False 18:46:16.413922 bus /gobi_0: Setting Powered False 18:46:17.534903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:46:18.678027 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:18.689195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:46:18.747747 tst iperf3.py: using LAC 22983 18:46:18.867241 tst iperf3.py: using RAC 33 18:46:18.985726 tst iperf3.py: using CellId 22983 18:46:19.102352 tst iperf3.py: using BVCI 22984 18:46:19.212112 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.222835 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.233438 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.243740 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.254084 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.264637 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.275155 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.285627 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:19.296129 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:19.409233 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:19.611689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:19.913558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2500): Launched 18:46:20.175293 run iperf3-srv_10.42.42.10(pid=2501): Launched 18:46:20.288209 tst iperf3.py:8: start network... 18:46:20.488904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:20.952671 run create_hlr_db(pid=2502): Launched 18:46:21.074096 bus /gobi_6: Setting Powered False 18:46:22.137637 run create_hlr_db(pid=2502): Terminated: ok {rc=0} 18:46:22.567802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2504): Launched 18:46:22.866584 run osmo-hlr_10.42.42.2(pid=2505): Launched 18:46:22.979485 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:23.508825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2507): Launched 18:46:23.808371 run osmo-stp_10.42.42.5(pid=2508): Launched 18:46:23.922197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:24.438713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2510): Launched 18:46:24.552598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:24.805940 run patchelf(pid=2511): Launched 18:46:24.972266 run osmo-stp_10.42.42.5(pid=2508): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2508)] 18:46:25.099091 run osmo-stp_10.42.42.5(pid=2508): stdout: | (launched: 2022-12-09_18:46:23.752939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:25.227503 run osmo-stp_10.42.42.5(pid=2508): stderr: | [0;m[38;5;43m20221209184623925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184623926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184623926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184623926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:25.356075 run osmo-stp_10.42.42.5(pid=2508): stdout: | (launched: 2022-12-09_18:46:23.752939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:25.479499 run osmo-stp_10.42.42.5(pid=2508): stderr: | [0;m[38;5;43m20221209184623925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184623926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184623926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184623926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184623927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:25.624846 run patchelf(pid=2511): Terminating (SIGINT) 18:46:25.792466 run patchelf(pid=2511): Terminated: ok {rc=0} 18:46:25.914789 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2508): Process ended prematurely: osmo-stp_10.42.42.5(pid=2508) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2508)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 18:46:25.924103 tst iperf3.py:8: Test FAILED (7.3 sec) 18:46:25.950722 run osmo-hlr_10.42.42.2(pid=2505): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2505)] 18:46:25.997429 run osmo-hlr_10.42.42.2(pid=2505): stdout: | (launched: 2022-12-09_18:46:22.811541) 18:46:26.045901 run osmo-hlr_10.42.42.2(pid=2505): stderr: | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184622989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184623001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184623010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184623010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184623010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:26.094690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2500): Terminating (SIGTERM) 18:46:26.133964 run iperf3-srv_10.42.42.10(pid=2501): Terminating (SIGTERM) 18:46:26.172919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2504): Terminating (SIGTERM) 18:46:26.211835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2507): Terminating (SIGTERM) 18:46:26.250671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2510): Terminating (SIGTERM) 18:46:26.289687 --- ParallelTerminationStrategy: PID 2500 died... 18:46:26.307846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2500): Terminated: ok {rc=0} 18:46:26.351464 --- ParallelTerminationStrategy: PID 2501 died... 18:46:26.369776 run iperf3-srv_10.42.42.10(pid=2501): Terminated {rc=256} 18:46:26.412651 --- ParallelTerminationStrategy: PID 2504 died... 18:46:26.430890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2504): Terminated: ok {rc=0} 18:46:26.473924 --- ParallelTerminationStrategy: PID 2507 died... 18:46:26.492265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2507): Terminated: ok {rc=0} 18:46:26.535284 --- ParallelTerminationStrategy: PID 2510 died... 18:46:26.553497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2510): Terminated: ok {rc=0} 18:46:26.635970 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:46:27.783365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:27.795162 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:46:27.854022 tst iperf3m4.py: using LAC 22984 18:46:27.981796 tst iperf3m4.py: using RAC 34 18:46:28.109364 tst iperf3m4.py: using CellId 22984 18:46:28.234911 tst iperf3m4.py: using BVCI 22985 18:46:28.351708 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.363153 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.374153 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.385952 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.397146 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.408309 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.419625 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.430945 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:28.442230 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:28.560104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:28.676515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:28.795674 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:28.914700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:29.132295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:29.455296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2512): Launched 18:46:29.734699 run iperf3-srv_10.42.42.10(pid=2513): Launched 18:46:29.854597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:46:30.072512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:30.395416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2514): Launched 18:46:30.673897 run iperf3-srv_10.42.42.10(pid=2515): Launched 18:46:30.793718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:46:31.057824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:31.407428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2516): Launched 18:46:31.693680 run iperf3-srv_10.42.42.10(pid=2517): Launched 18:46:31.819811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:46:32.026069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:32.331187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2518): Launched 18:46:32.591730 run iperf3-srv_10.42.42.10(pid=2519): Launched 18:46:32.703102 tst iperf3m4.py:8: start network... 18:46:32.902685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:33.365806 run create_hlr_db(pid=2520): Launched 18:46:33.487429 bus /gobi_6: Setting Powered False 18:46:34.546851 run create_hlr_db(pid=2520): Terminated: ok {rc=0} 18:46:34.985888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Launched 18:46:35.308113 run osmo-hlr_10.42.42.2(pid=2523): Launched 18:46:35.431327 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:35.992841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2525): Launched 18:46:36.313789 run osmo-stp_10.42.42.5(pid=2526): Launched 18:46:36.435591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:36.991059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2528): Launched 18:46:37.113855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:37.386810 run patchelf(pid=2529): Launched 18:46:37.565767 run osmo-stp_10.42.42.5(pid=2526): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2526)] 18:46:37.702341 run osmo-stp_10.42.42.5(pid=2526): stdout: | (launched: 2022-12-09_18:46:36.255240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:37.840277 run osmo-stp_10.42.42.5(pid=2526): stderr: | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184636445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:37.978872 run osmo-stp_10.42.42.5(pid=2526): stdout: | (launched: 2022-12-09_18:46:36.255240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:38.111199 run osmo-stp_10.42.42.5(pid=2526): stderr: | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184636444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184636445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184636445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:38.267935 run patchelf(pid=2529): Terminating (SIGINT) 18:46:38.447737 run patchelf(pid=2529): Terminated: ok {rc=0} 18:46:38.577233 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2526): Process ended prematurely: osmo-stp_10.42.42.5(pid=2526) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2526)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:46:38.587246 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:46:38.616119 run osmo-hlr_10.42.42.2(pid=2523): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2523)] 18:46:38.665436 run osmo-hlr_10.42.42.2(pid=2523): stdout: | (launched: 2022-12-09_18:46:35.249230) 18:46:38.716158 run osmo-hlr_10.42.42.2(pid=2523): stderr: | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184635445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184635461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184635471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184635471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184635471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:38.767384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2512): Terminating (SIGTERM) 18:46:38.808443 run iperf3-srv_10.42.42.10(pid=2513): Terminating (SIGTERM) 18:46:38.849795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2514): Terminating (SIGTERM) 18:46:38.891544 run iperf3-srv_10.42.42.10(pid=2515): Terminating (SIGTERM) 18:46:38.932931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2516): Terminating (SIGTERM) 18:46:38.974476 run iperf3-srv_10.42.42.10(pid=2517): Terminating (SIGTERM) 18:46:39.015610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2518): Terminating (SIGTERM) 18:46:39.056870 run iperf3-srv_10.42.42.10(pid=2519): Terminating (SIGTERM) 18:46:39.098115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Terminating (SIGTERM) 18:46:39.139437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2525): Terminating (SIGTERM) 18:46:39.180687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2528): Terminating (SIGTERM) 18:46:39.222252 --- ParallelTerminationStrategy: PID 2512 died... 18:46:39.242022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2512): Terminated: ok {rc=0} 18:46:39.288255 --- ParallelTerminationStrategy: PID 2513 died... 18:46:39.307595 run iperf3-srv_10.42.42.10(pid=2513): Terminated {rc=256} 18:46:39.353555 --- ParallelTerminationStrategy: PID 2514 died... 18:46:39.372843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2514): Terminated: ok {rc=0} 18:46:39.418901 --- ParallelTerminationStrategy: PID 2515 died... 18:46:39.438174 run iperf3-srv_10.42.42.10(pid=2515): Terminated {rc=256} 18:46:39.484069 --- ParallelTerminationStrategy: PID 2516 died... 18:46:39.503308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2516): Terminated: ok {rc=0} 18:46:39.549448 --- ParallelTerminationStrategy: PID 2517 died... 18:46:39.568626 run iperf3-srv_10.42.42.10(pid=2517): Terminated {rc=256} 18:46:39.614523 --- ParallelTerminationStrategy: PID 2518 died... 18:46:39.633848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2518): Terminated: ok {rc=0} 18:46:39.679909 --- ParallelTerminationStrategy: PID 2519 died... 18:46:39.699236 run iperf3-srv_10.42.42.10(pid=2519): Terminated {rc=256} 18:46:39.745148 --- ParallelTerminationStrategy: PID 2522 died... 18:46:39.764439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Terminated: ok {rc=0} 18:46:39.810496 --- ParallelTerminationStrategy: PID 2525 died... 18:46:39.829837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2525): Terminated: ok {rc=0} 18:46:39.875674 --- ParallelTerminationStrategy: PID 2528 died... 18:46:39.895211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2528): Terminated: ok {rc=0} 18:46:39.982970 bus /gobi_4: Setting Powered False 18:46:41.080512 bus /gobi_4: Setting Powered False 18:46:42.197714 bus /gobi_1: Setting Powered False 18:46:43.297088 bus /gobi_1: Setting Powered False 18:46:44.411544 bus /gobi_0: Setting Powered False 18:46:45.507447 bus /gobi_0: Setting Powered False 18:46:46.621137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:46:47.721278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:47.732327 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:46:47.788912 tst ping.py: using LAC 22985 18:46:47.906315 tst ping.py: using RAC 35 18:46:48.021683 tst ping.py: using CellId 22985 18:46:48.139068 tst ping.py: using BVCI 22986 18:46:48.247634 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.258425 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.268835 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.279276 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.289617 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.299981 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.310564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:48.320883 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:48.432904 tst ping.py:19: start network... 18:46:48.631003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:49.088450 run create_hlr_db(pid=2530): Launched 18:46:49.208792 bus /gobi_6: Setting Powered False 18:46:50.267338 run create_hlr_db(pid=2530): Terminated: ok {rc=0} 18:46:50.679495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Launched 18:46:50.974493 run osmo-hlr_10.42.42.2(pid=2533): Launched 18:46:51.085710 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:51.630210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Launched 18:46:51.924749 run osmo-stp_10.42.42.5(pid=2536): Launched 18:46:52.035149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:52.540282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Launched 18:46:52.651403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:52.898521 run patchelf(pid=2539): Launched 18:46:53.061243 run osmo-stp_10.42.42.5(pid=2536): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] 18:46:53.185233 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-09_18:46:51.869782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:53.310585 run osmo-stp_10.42.42.5(pid=2536): stderr: | [0;m[38;5;43m20221209184652040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184652040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184652041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184652041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:53.436232 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-09_18:46:51.869782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:53.556161 run osmo-stp_10.42.42.5(pid=2536): stderr: | [0;m[38;5;43m20221209184652040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184652040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184652041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184652041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184652042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:53.699074 run patchelf(pid=2539): Terminating (SIGINT) 18:46:53.862927 run patchelf(pid=2539): Terminated: ok {rc=0} 18:46:53.981554 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 18:46:53.990217 tst ping.py:22: Test FAILED (6.3 sec) 18:46:54.016439 run osmo-hlr_10.42.42.2(pid=2533): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2533)] 18:46:54.063500 run osmo-hlr_10.42.42.2(pid=2533): stdout: | (launched: 2022-12-09_18:46:50.919638) 18:46:54.111973 run osmo-hlr_10.42.42.2(pid=2533): stderr: | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184651094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184651106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184651115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184651115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184651115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:54.160754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminating (SIGTERM) 18:46:54.199632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminating (SIGTERM) 18:46:54.238423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Terminating (SIGTERM) 18:46:54.277692 --- ParallelTerminationStrategy: PID 2532 died... 18:46:54.296413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminated: ok {rc=0} 18:46:54.339597 --- ParallelTerminationStrategy: PID 2535 died... 18:46:54.357893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminated: ok {rc=0} 18:46:54.401165 --- ParallelTerminationStrategy: PID 2538 died... 18:46:54.419357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Terminated: ok {rc=0} 18:46:54.504083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:46:55.591590 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:55.602726 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:46:55.659450 tst ping_idle_ping.py: using LAC 22986 18:46:55.777440 tst ping_idle_ping.py: using RAC 36 18:46:55.893136 tst ping_idle_ping.py: using CellId 22986 18:46:56.008899 tst ping_idle_ping.py: using BVCI 22987 18:46:56.115623 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.126453 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.136831 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.147230 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.157699 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.168044 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.178628 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:46:56.189036 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:46:56.306591 tst ping_idle_ping.py:24: start network... 18:46:56.520622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:57.014175 run create_hlr_db(pid=2540): Launched 18:46:57.134491 bus /gobi_6: Setting Powered False 18:46:58.197549 run create_hlr_db(pid=2540): Terminated: ok {rc=0} 18:46:58.620647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2542): Launched 18:46:58.917740 run osmo-hlr_10.42.42.2(pid=2543): Launched 18:46:59.030925 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:59.550895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2545): Launched 18:46:59.846534 run osmo-stp_10.42.42.5(pid=2546): Launched 18:46:59.958820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:00.467408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2548): Launched 18:47:00.579185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:00.841760 run patchelf(pid=2549): Launched 18:47:01.030358 run osmo-stp_10.42.42.5(pid=2546): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2546)] 18:47:01.157769 run osmo-stp_10.42.42.5(pid=2546): stdout: | (launched: 2022-12-09_18:46:59.791874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:01.286418 run osmo-stp_10.42.42.5(pid=2546): stderr: | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184659963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:01.415282 run osmo-stp_10.42.42.5(pid=2546): stdout: | (launched: 2022-12-09_18:46:59.791874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:01.538061 run osmo-stp_10.42.42.5(pid=2546): stderr: | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184659962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184659963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184659963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:01.688705 run patchelf(pid=2549): Terminating (SIGINT) 18:47:01.858884 run patchelf(pid=2549): Terminated: ok {rc=0} 18:47:01.995075 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2546): Process ended prematurely: osmo-stp_10.42.42.5(pid=2546) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2546)] [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:47:02.005890 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:47:02.037640 run osmo-hlr_10.42.42.2(pid=2543): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2543)] 18:47:02.090675 run osmo-hlr_10.42.42.2(pid=2543): stdout: | (launched: 2022-12-09_18:46:58.863094) 18:47:02.144849 run osmo-hlr_10.42.42.2(pid=2543): stderr: | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184659039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184659052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184659062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184659062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184659062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:02.200400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2542): Terminating (SIGTERM) 18:47:02.242429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2545): Terminating (SIGTERM) 18:47:02.284717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2548): Terminating (SIGTERM) 18:47:02.327467 --- ParallelTerminationStrategy: PID 2542 died... 18:47:02.347512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2542): Terminated: ok {rc=0} 18:47:02.395211 --- ParallelTerminationStrategy: PID 2545 died... 18:47:02.414811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2545): Terminated: ok {rc=0} 18:47:02.461543 --- ParallelTerminationStrategy: PID 2548 died... 18:47:02.481153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2548): Terminated: ok {rc=0} 18:47:02.571299 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:47:03.857992 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:03.864733 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:47:03.886095 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:47:03.920928 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:47:03.973706 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:47:03.994125 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:47:04.028493 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:47:04.584216 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:47:04.589453 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:04.600503 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:47:04.660179 tst switch_tch_pdch.py: using LAC 22987 18:47:04.785821 tst switch_tch_pdch.py: using RAC 37 18:47:04.908570 tst switch_tch_pdch.py: using CellId 22987 18:47:05.032111 tst switch_tch_pdch.py: using BVCI 22988 18:47:05.148207 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.159744 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.170988 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.182557 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.193951 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.205442 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.216901 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:47:05.228435 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:47:05.345441 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:47:05.466867 tst switch_tch_pdch.py:51: start network... 18:47:05.680576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:06.170722 run create_hlr_db(pid=2553): Launched 18:47:06.290015 bus /gobi_6: Setting Powered False 18:47:07.352775 run create_hlr_db(pid=2553): Terminated: ok {rc=0} 18:47:07.793106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2555): Launched 18:47:08.108535 run osmo-hlr_10.42.42.2(pid=2556): Launched 18:47:08.228894 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:08.774226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2558): Launched 18:47:09.088278 run osmo-stp_10.42.42.5(pid=2559): Launched 18:47:09.208123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:09.750993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2561): Launched 18:47:09.871166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:10.137567 run patchelf(pid=2562): Launched 18:47:10.311674 run osmo-stp_10.42.42.5(pid=2559): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2559)] 18:47:10.445261 run osmo-stp_10.42.42.5(pid=2559): stdout: | (launched: 2022-12-09_18:47:09.030456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:10.580359 run osmo-stp_10.42.42.5(pid=2559): stderr: | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184709224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:10.715486 run osmo-stp_10.42.42.5(pid=2559): stdout: | (launched: 2022-12-09_18:47:09.030456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:10.844749 run osmo-stp_10.42.42.5(pid=2559): stderr: | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184709224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184709224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184709225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:10.998673 run patchelf(pid=2562): Terminating (SIGINT) 18:47:11.174657 run patchelf(pid=2562): Terminated: ok {rc=0} 18:47:11.301567 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2559): Process ended prematurely: osmo-stp_10.42.42.5(pid=2559) [trial-2363↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2559)] [trial-2363↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:47:11.310995 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:47:11.339094 run osmo-hlr_10.42.42.2(pid=2556): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2556)] 18:47:11.388278 run osmo-hlr_10.42.42.2(pid=2556): stdout: | (launched: 2022-12-09_18:47:08.050694) 18:47:11.439174 run osmo-hlr_10.42.42.2(pid=2556): stderr: | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184708250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184708266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184708275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184708276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184708276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:11.490228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2555): Terminating (SIGTERM) 18:47:11.531253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2558): Terminating (SIGTERM) 18:47:11.572260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2561): Terminating (SIGTERM) 18:47:11.613511 --- ParallelTerminationStrategy: PID 2555 died... 18:47:11.633152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2555): Terminated: ok {rc=0} 18:47:11.678890 --- ParallelTerminationStrategy: PID 2558 died... 18:47:11.698151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2558): Terminated: ok {rc=0} 18:47:11.743891 --- ParallelTerminationStrategy: PID 2561 died... 18:47:11.763077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2561): Terminated: ok {rc=0} 18:47:11.850543 bus /gobi_0: Setting Powered False 18:47:12.948399 bus /gobi_0: Setting Powered False 18:47:14.062769 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:47:15.293522 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:15.298960 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:47:15.319083 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:47:15.352823 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:47:15.404699 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:47:15.425067 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:47:15.458572 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:47:16.033482 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:47:16.041411 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.053705 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:47:16.114949 tst switch_tch_pdch.py: using LAC 22988 18:47:16.246182 tst switch_tch_pdch.py: using RAC 38 18:47:16.374423 tst switch_tch_pdch.py: using CellId 22988 18:47:16.501172 tst switch_tch_pdch.py: using BVCI 22989 18:47:16.621292 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.633473 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.645600 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.659547 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.673084 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.685086 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.699377 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:47:16.711421 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:47:16.835822 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:47:16.975839 tst switch_tch_pdch.py:51: start network... 18:47:17.228844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:17.692874 run create_hlr_db(pid=2566): Launched 18:47:17.812483 bus /gobi_6: Setting Powered False 18:47:18.876279 run create_hlr_db(pid=2566): Terminated: ok {rc=0} 18:47:19.274387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2568): Launched 18:47:19.569904 run osmo-hlr_10.42.42.2(pid=2569): Launched 18:47:19.682553 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:20.163719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2571): Launched 18:47:20.457817 run osmo-stp_10.42.42.5(pid=2572): Launched 18:47:20.569891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:21.052340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2574): Launched 18:47:21.164589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:21.413582 run patchelf(pid=2575): Launched 18:47:21.576877 run osmo-stp_10.42.42.5(pid=2572): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2572)] 18:47:21.701769 run osmo-stp_10.42.42.5(pid=2572): stdout: | (launched: 2022-12-09_18:47:20.402996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:21.827523 run osmo-stp_10.42.42.5(pid=2572): stderr: | [0;m[38;5;43m20221209184720573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184720574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184720574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184720574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:21.953764 run osmo-stp_10.42.42.5(pid=2572): stdout: | (launched: 2022-12-09_18:47:20.402996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:22.074026 run osmo-stp_10.42.42.5(pid=2572): stderr: | [0;m[38;5;43m20221209184720573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184720574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184720574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184720574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184720575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:22.217632 run patchelf(pid=2575): Terminating (SIGINT) 18:47:22.381847 run patchelf(pid=2575): Terminated: ok {rc=0} 18:47:22.500085 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2572): Process ended prematurely: osmo-stp_10.42.42.5(pid=2572) [trial-2363↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2572)] [trial-2363↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:47:22.509036 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 18:47:22.534986 run osmo-hlr_10.42.42.2(pid=2569): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2569)] 18:47:22.581162 run osmo-hlr_10.42.42.2(pid=2569): stdout: | (launched: 2022-12-09_18:47:19.515325) 18:47:22.628894 run osmo-hlr_10.42.42.2(pid=2569): stderr: | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184719690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184719704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184719714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184719714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184719714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:22.676931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2568): Terminating (SIGTERM) 18:47:22.715434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2571): Terminating (SIGTERM) 18:47:22.753997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2574): Terminating (SIGTERM) 18:47:22.793249 --- ParallelTerminationStrategy: PID 2568 died... 18:47:22.811715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2568): Terminated: ok {rc=0} 18:47:22.855190 --- ParallelTerminationStrategy: PID 2571 died... 18:47:22.873494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2571): Terminated: ok {rc=0} 18:47:22.916201 --- ParallelTerminationStrategy: PID 2574 died... 18:47:22.934382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2574): Terminated: ok {rc=0} 18:47:23.015809 bus /gobi_0: Setting Powered False 18:47:24.111081 bus /gobi_0: Setting Powered False 18:47:25.225544 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:oc2g --------------------------------------------------------------------- 18:47:26.459835 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:26.463782 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 18:47:26.484705 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 18:47:26.491893 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 18:47:26.543545 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 18:47:26.564238 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 18:47:26.570960 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 18:47:27.111979 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 18:47:27.117084 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 18:47:27.127918 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 18:47:27.163264 tst mo_mt_sms.py: using LAC 22989 18:47:27.279992 tst mo_mt_sms.py: using RAC 39 18:47:27.394524 tst mo_mt_sms.py: using CellId 22989 18:47:27.508087 tst mo_mt_sms.py: using BVCI 22990 18:47:27.615249 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 18:47:27.732045 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 18:47:27.844644 tst mo_mt_sms.py:9: start nitb and bts... 18:47:28.044600 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:47:28.647974 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2580): Launched 18:47:28.944014 run osmo-nitb_10.42.42.2(pid=2581): Launched 18:47:29.107338 run osmo-nitb_10.42.42.2(pid=2581): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2581)] 18:47:29.240126 run osmo-nitb_10.42.42.2(pid=2581): stdout: | (launched: 2022-12-09_18:47:28.889423) 18:47:29.373644 run osmo-nitb_10.42.42.2(pid=2581): stderr: | (launched: 2022-12-09_18:47:28.933318) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:47:29.507259 run osmo-nitb_10.42.42.2(pid=2581): stdout: | (launched: 2022-12-09_18:47:28.889423) 18:47:29.634950 run osmo-nitb_10.42.42.2(pid=2581): stderr: | (launched: 2022-12-09_18:47:28.933318) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2581): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2581) [trial-2363↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2581)] 18:47:30.055763 tst osmo-nitb_10.42.42.2(pid=2581): stdout: | (launched: 2022-12-09_18:47:28.889423) 18:47:30.175721 tst osmo-nitb_10.42.42.2(pid=2581): stderr: | (launched: 2022-12-09_18:47:28.933318) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:47:30.316524 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2581): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2581) [trial-2363↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2581)] [trial-2363↪nitb_sms:oc2g↪mo_mt_sms.py:11] 18:47:30.324660 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 18:47:30.331035 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2580): Terminating (SIGTERM) 18:47:30.539017 --- ParallelTerminationStrategy: PID 2580 died... 18:47:30.559174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2580): Terminated: ok {rc=0} 18:47:30.643473 bus /sierra_3: Setting Powered False 18:47:31.741268 bus /sierra_3: Setting Powered False 18:47:32.857739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:oc2g --------------------------------------------------------------------- 18:47:34.035216 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:34.038973 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 18:47:34.058843 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 18:47:34.084774 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 18:47:34.136263 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 18:47:34.157724 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 18:47:34.185560 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 18:47:34.729995 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:oc2g mo_mt_sms.py ---------------------------------------------- 18:47:34.735295 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:34.746152 tst sms:oc2g: Using 1 x bts (candidates: 1) 18:47:34.780878 tst mo_mt_sms.py: using LAC 22990 18:47:34.904073 tst mo_mt_sms.py: using RAC 40 18:47:35.029720 tst mo_mt_sms.py: using CellId 22990 18:47:35.145066 tst mo_mt_sms.py: using BVCI 22991 18:47:35.251579 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:35.262093 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:35.272401 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:35.282819 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:35.293119 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:47:35.303209 tst sms:oc2g: Using 1 x modem (candidates: 2) 18:47:35.418550 tst sms:oc2g: Using 1 x modem (candidates: 2) 18:47:35.531122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:36.000044 run create_hlr_db(pid=2586): Launched 18:47:36.120874 bus /sierra_2: Setting Powered False 18:47:37.183509 run create_hlr_db(pid=2586): Terminated: ok {rc=0} 18:47:37.606793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Launched 18:47:37.901279 run osmo-hlr_10.42.42.2(pid=2589): Launched 18:47:38.013572 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:38.522453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Launched 18:47:38.817084 run osmo-stp_10.42.42.5(pid=2592): Launched 18:47:38.928760 run osmo-msc_10.42.42.6: Starting osmo-msc 18:47:39.462689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Launched 18:47:39.756741 run osmo-msc_10.42.42.6(pid=2595): Launched 18:47:39.922210 run osmo-stp_10.42.42.5(pid=2592): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2592)] 18:47:40.049839 run osmo-stp_10.42.42.5(pid=2592): stdout: | (launched: 2022-12-09_18:47:38.762229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:40.175733 run osmo-stp_10.42.42.5(pid=2592): stderr: | [0;m[38;5;43m20221209184738933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184738934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184738934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184738934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:40.298806 run osmo-stp_10.42.42.5(pid=2592): stdout: | (launched: 2022-12-09_18:47:38.762229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:40.416276 run osmo-stp_10.42.42.5(pid=2592): stderr: | [0;m[38;5;43m20221209184738933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184738934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184738934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184738934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184738935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:40.556735 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2592): Process ended prematurely: osmo-stp_10.42.42.5(pid=2592) [trial-2363↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2592)] [trial-2363↪sms:oc2g↪mo_mt_sms.py:16] 18:47:40.564935 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 18:47:40.590249 run osmo-hlr_10.42.42.2(pid=2589): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2589)] 18:47:40.636625 run osmo-hlr_10.42.42.2(pid=2589): stdout: | (launched: 2022-12-09_18:47:37.846556) 18:47:40.684410 run osmo-hlr_10.42.42.2(pid=2589): stderr: | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184738022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184738034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184738043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184738043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184738043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:40.751152 run osmo-msc_10.42.42.6(pid=2595): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2595)] 18:47:40.797398 run osmo-msc_10.42.42.6(pid=2595): stdout: | (launched: 2022-12-09_18:47:39.702231) 18:47:40.845087 run osmo-msc_10.42.42.6(pid=2595): stderr: | [0;m[38;5;43m20221209184739977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184739977 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf9c12ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184739977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184739977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184739977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184739978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184739979 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184739980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184739980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184739980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:47:40.892715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Terminating (SIGTERM) 18:47:40.931094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Terminating (SIGTERM) 18:47:40.969437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Terminating (SIGTERM) 18:47:41.007909 --- ParallelTerminationStrategy: PID 2588 died... 18:47:41.026447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Terminated: ok {rc=0} 18:47:41.069226 --- ParallelTerminationStrategy: PID 2591 died... 18:47:41.087409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Terminated: ok {rc=0} 18:47:41.130073 --- ParallelTerminationStrategy: PID 2594 died... 18:47:41.148179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Terminated: ok {rc=0} 18:47:41.231911 bus /sierra_3: Setting Powered False 18:47:42.329313 bus /sierra_3: Setting Powered False 18:47:43.442897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:oc2g --------------------------------------------------------------------- 18:47:44.650558 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:44.654075 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 18:47:44.673940 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 18:47:44.680439 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 18:47:44.713000 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 18:47:44.733009 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 18:47:44.739476 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 18:47:45.259561 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 18:47:45.265940 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 18:47:45.276858 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 18:47:45.312769 tst assert_extension.py: using LAC 22991 18:47:45.434413 tst assert_extension.py: using RAC 41 18:47:45.549379 tst assert_extension.py: using CellId 22991 18:47:45.667383 tst assert_extension.py: using BVCI 22992 18:47:45.783565 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 18:47:45.918499 tst assert_extension.py:10: start nitb and bts... 18:47:46.122378 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:47:46.829858 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2600): Launched 18:47:47.142825 run osmo-nitb_10.42.42.2(pid=2601): Launched 18:47:47.325071 run osmo-nitb_10.42.42.2(pid=2601): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2601)] 18:47:47.457892 run osmo-nitb_10.42.42.2(pid=2601): stdout: | (launched: 2022-12-09_18:47:47.080757) 18:47:47.592300 run osmo-nitb_10.42.42.2(pid=2601): stderr: | (launched: 2022-12-09_18:47:47.126027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:47:47.726211 run osmo-nitb_10.42.42.2(pid=2601): stdout: | (launched: 2022-12-09_18:47:47.080757) 18:47:47.854645 run osmo-nitb_10.42.42.2(pid=2601): stderr: | (launched: 2022-12-09_18:47:47.126027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2601) [trial-2363↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2601)] 18:47:48.273110 tst osmo-nitb_10.42.42.2(pid=2601): stdout: | (launched: 2022-12-09_18:47:47.080757) 18:47:48.393025 tst osmo-nitb_10.42.42.2(pid=2601): stderr: | (launched: 2022-12-09_18:47:47.126027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:47:48.533207 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2601) [trial-2363↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2601)] [trial-2363↪nitb_ussd:oc2g↪assert_extension.py:12] 18:47:48.541475 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:47:48.548151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2600): Terminating (SIGTERM) 18:47:48.755957 --- ParallelTerminationStrategy: PID 2600 died... 18:47:48.776490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2600): Terminated: ok {rc=0} 18:47:48.860284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:oc2g --------------------------------------------------------------------- 18:47:50.022492 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:50.026299 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 18:47:50.046141 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 18:47:50.072423 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 18:47:50.105553 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 18:47:50.125930 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 18:47:50.152245 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 18:47:50.679997 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:oc2g assert_extension.py ---------------------------------------------- 18:47:50.684707 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:50.695010 tst ussd:oc2g: Using 1 x bts (candidates: 1) 18:47:50.727446 tst assert_extension.py: using LAC 22992 18:47:50.850241 tst assert_extension.py: using RAC 42 18:47:50.972698 tst assert_extension.py: using CellId 22992 18:47:51.094076 tst assert_extension.py: using BVCI 22993 18:47:51.208468 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:51.219394 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:51.230291 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:51.241168 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:51.252027 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:47:51.262917 tst ussd:oc2g: Using 1 x modem (candidates: 1) 18:47:51.376301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:51.867476 run create_hlr_db(pid=2606): Launched 18:47:51.987887 bus /sierra_2: Setting Powered False 18:47:53.051137 run create_hlr_db(pid=2606): Terminated: ok {rc=0} 18:47:53.473670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2608): Launched 18:47:53.768708 run osmo-hlr_10.42.42.2(pid=2609): Launched 18:47:53.881330 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:54.394009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2611): Launched 18:47:54.688249 run osmo-stp_10.42.42.5(pid=2612): Launched 18:47:54.800306 run osmo-msc_10.42.42.6: Starting osmo-msc 18:47:55.330876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2614): Launched 18:47:55.623974 run osmo-msc_10.42.42.6(pid=2615): Launched 18:47:55.787582 run osmo-stp_10.42.42.5(pid=2612): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2612)] 18:47:55.911706 run osmo-stp_10.42.42.5(pid=2612): stdout: | (launched: 2022-12-09_18:47:54.633722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:56.035813 run osmo-stp_10.42.42.5(pid=2612): stderr: | [0;m[38;5;43m20221209184754803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184754804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184754804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184754804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:56.157723 run osmo-stp_10.42.42.5(pid=2612): stdout: | (launched: 2022-12-09_18:47:54.633722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:56.275680 run osmo-stp_10.42.42.5(pid=2612): stderr: | [0;m[38;5;43m20221209184754803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184754804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184754804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184754804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184754805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:56.415315 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2612): Process ended prematurely: osmo-stp_10.42.42.5(pid=2612) [trial-2363↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2612)] [trial-2363↪ussd:oc2g↪assert_extension.py:17] 18:47:56.423486 tst assert_extension.py:17: Test FAILED (5.7 sec) 18:47:56.449044 run osmo-hlr_10.42.42.2(pid=2609): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2609)] 18:47:56.495414 run osmo-hlr_10.42.42.2(pid=2609): stdout: | (launched: 2022-12-09_18:47:53.713259) 18:47:56.543223 run osmo-hlr_10.42.42.2(pid=2609): stderr: | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184753889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184753903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184753913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184753913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184753913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:56.610085 run osmo-msc_10.42.42.6(pid=2615): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2615)] 18:47:56.656276 run osmo-msc_10.42.42.6(pid=2615): stdout: | (launched: 2022-12-09_18:47:55.569687) 18:47:56.703950 run osmo-msc_10.42.42.6(pid=2615): stderr: | [0;m[38;5;43m20221209184755842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184755842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f048bf09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184755842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184755842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184755842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184755842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184755844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184755844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184755845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184755845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:47:56.752062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2608): Terminating (SIGTERM) 18:47:56.790447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2611): Terminating (SIGTERM) 18:47:56.829060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2614): Terminating (SIGTERM) 18:47:56.867724 --- ParallelTerminationStrategy: PID 2608 died... 18:47:56.886303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2608): Terminated: ok {rc=0} 18:47:56.928890 --- ParallelTerminationStrategy: PID 2611 died... 18:47:56.947021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2611): Terminated: ok {rc=0} 18:47:56.989912 --- ParallelTerminationStrategy: PID 2614 died... 18:47:57.007935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2614): Terminated: ok {rc=0} 18:47:57.091078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:47:58.286359 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:58.292668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:47:58.313126 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:47:58.339136 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:47:58.390058 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:47:58.410758 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:47:58.436501 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:47:58.984295 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:47:59.032757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.043498 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:47:59.100785 tst mo_mt_call.py: using LAC 22993 18:47:59.217728 tst mo_mt_call.py: using RAC 43 18:47:59.334964 tst mo_mt_call.py: using CellId 22993 18:47:59.451530 tst mo_mt_call.py: using BVCI 22994 18:47:59.559095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.569946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.580463 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.591022 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.601697 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:47:59.612271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:47:59.730973 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:47:59.845899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:00.346034 run create_hlr_db(pid=2620): Launched 18:48:00.468432 bus /sierra_2: Setting Powered False 18:48:01.531341 run create_hlr_db(pid=2620): Terminated: ok {rc=0} 18:48:02.000436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Launched 18:48:02.328680 run osmo-hlr_10.42.42.2(pid=2623): Launched 18:48:02.453225 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:03.013484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2625): Launched 18:48:03.336358 run osmo-stp_10.42.42.5(pid=2626): Launched 18:48:03.459674 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:04.043159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2628): Launched 18:48:04.366151 run osmo-msc_10.42.42.6(pid=2629): Launched 18:48:04.544879 run osmo-stp_10.42.42.5(pid=2626): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2626)] 18:48:04.681535 run osmo-stp_10.42.42.5(pid=2626): stdout: | (launched: 2022-12-09_18:48:03.277167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:04.818502 run osmo-stp_10.42.42.5(pid=2626): stderr: | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184803471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:04.954241 run osmo-stp_10.42.42.5(pid=2626): stdout: | (launched: 2022-12-09_18:48:03.277167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:05.082783 run osmo-stp_10.42.42.5(pid=2626): stderr: | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184803470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184803471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184803471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:05.236616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2626): Process ended prematurely: osmo-stp_10.42.42.5(pid=2626) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2626)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:48:05.246335 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:48:05.274445 run osmo-hlr_10.42.42.2(pid=2623): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2623)] 18:48:05.323932 run osmo-hlr_10.42.42.2(pid=2623): stdout: | (launched: 2022-12-09_18:48:02.269471) 18:48:05.374986 run osmo-hlr_10.42.42.2(pid=2623): stderr: | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184802467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184802479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184802488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184802488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184802488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:05.445895 run osmo-msc_10.42.42.6(pid=2629): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2629)] 18:48:05.495162 run osmo-msc_10.42.42.6(pid=2629): stdout: | (launched: 2022-12-09_18:48:04.306906) 18:48:05.545954 run osmo-msc_10.42.42.6(pid=2629): stderr: | [0;m[38;5;43m20221209184804629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184804629 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9ed063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184804629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184804629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184804629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184804630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184804631 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184804632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184804632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184804632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:05.597498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Terminating (SIGTERM) 18:48:05.638506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2625): Terminating (SIGTERM) 18:48:05.679551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2628): Terminating (SIGTERM) 18:48:05.721107 --- ParallelTerminationStrategy: PID 2622 died... 18:48:05.740722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Terminated: ok {rc=0} 18:48:05.786536 --- ParallelTerminationStrategy: PID 2625 died... 18:48:05.805787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2625): Terminated: ok {rc=0} 18:48:05.851406 --- ParallelTerminationStrategy: PID 2628 died... 18:48:05.870696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2628): Terminated: ok {rc=0} 18:48:05.957985 bus /sierra_3: Setting Powered False 18:48:07.054576 bus /sierra_3: Setting Powered False 18:48:08.170373 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:48:09.317977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.330014 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:48:09.387466 tst mo_mt_call_osmux.py: using LAC 22994 18:48:09.513608 tst mo_mt_call_osmux.py: using RAC 44 18:48:09.642252 tst mo_mt_call_osmux.py: using CellId 22994 18:48:09.767844 tst mo_mt_call_osmux.py: using BVCI 22995 18:48:09.884731 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.896382 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.907599 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.919071 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.930877 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:09.942344 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:10.058590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:10.172590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:10.674125 run create_hlr_db(pid=2631): Launched 18:48:10.795925 bus /sierra_2: Setting Powered False 18:48:11.859892 run create_hlr_db(pid=2631): Terminated: ok {rc=0} 18:48:12.289212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2633): Launched 18:48:12.589191 run osmo-hlr_10.42.42.2(pid=2634): Launched 18:48:12.702004 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:13.231158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2636): Launched 18:48:13.530697 run osmo-stp_10.42.42.5(pid=2637): Launched 18:48:13.643353 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:14.183267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2639): Launched 18:48:14.482269 run osmo-msc_10.42.42.6(pid=2640): Launched 18:48:14.647969 run osmo-stp_10.42.42.5(pid=2637): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2637)] 18:48:14.774099 run osmo-stp_10.42.42.5(pid=2637): stdout: | (launched: 2022-12-09_18:48:13.475260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:14.900595 run osmo-stp_10.42.42.5(pid=2637): stderr: | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184813649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:15.024722 run osmo-stp_10.42.42.5(pid=2637): stdout: | (launched: 2022-12-09_18:48:13.475260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:15.143681 run osmo-stp_10.42.42.5(pid=2637): stderr: | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184813648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184813649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184813649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:15.286306 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2637): Process ended prematurely: osmo-stp_10.42.42.5(pid=2637) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2637)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:48:15.294913 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:48:15.320732 run osmo-hlr_10.42.42.2(pid=2634): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2634)] 18:48:15.366996 run osmo-hlr_10.42.42.2(pid=2634): stdout: | (launched: 2022-12-09_18:48:12.534002) 18:48:15.414843 run osmo-hlr_10.42.42.2(pid=2634): stderr: | [0;m[1;31m20221209184812710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184812710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184812710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184812710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184812710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184812711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184812722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184812731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184812732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184812732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:15.481729 run osmo-msc_10.42.42.6(pid=2640): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2640)] 18:48:15.527910 run osmo-msc_10.42.42.6(pid=2640): stdout: | (launched: 2022-12-09_18:48:14.427127) 18:48:15.575625 run osmo-msc_10.42.42.6(pid=2640): stderr: | [0;m[38;5;43m20221209184814701 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184814701 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7facf422cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184814701 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184814702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184814702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184814702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184814704 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184814704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184814705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184814705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:15.623850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2633): Terminating (SIGTERM) 18:48:15.662265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2636): Terminating (SIGTERM) 18:48:15.700572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2639): Terminating (SIGTERM) 18:48:15.739227 --- ParallelTerminationStrategy: PID 2633 died... 18:48:15.757785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2633): Terminated: ok {rc=0} 18:48:15.800185 --- ParallelTerminationStrategy: PID 2636 died... 18:48:15.818333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2636): Terminated: ok {rc=0} 18:48:15.890074 --- ParallelTerminationStrategy: PID 2639 died... 18:48:15.910228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2639): Terminated: ok {rc=0} 18:48:16.003309 bus /sierra_3: Setting Powered False 18:48:17.100569 bus /sierra_3: Setting Powered False 18:48:18.209926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:48:19.438363 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:19.445392 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:48:19.466640 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:48:19.493839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:48:19.544213 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:48:19.565454 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:48:19.592290 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:48:20.144612 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:48:20.196737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.208119 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:48:20.262614 tst mo_mt_call.py: using LAC 22995 18:48:20.386146 tst mo_mt_call.py: using RAC 45 18:48:20.510156 tst mo_mt_call.py: using CellId 22995 18:48:20.633753 tst mo_mt_call.py: using BVCI 22996 18:48:20.752216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.763573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.774683 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.786157 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.797544 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:20.808710 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:48:20.923178 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:48:21.036832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:21.501691 run create_hlr_db(pid=2645): Launched 18:48:21.624253 bus /sierra_2: Setting Powered False 18:48:22.684541 run create_hlr_db(pid=2645): Terminated: ok {rc=0} 18:48:23.124473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2647): Launched 18:48:23.446210 run osmo-hlr_10.42.42.2(pid=2648): Launched 18:48:23.568670 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:24.126764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2650): Launched 18:48:24.448755 run osmo-stp_10.42.42.5(pid=2651): Launched 18:48:24.571622 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:25.154655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2653): Launched 18:48:25.476565 run osmo-msc_10.42.42.6(pid=2654): Launched 18:48:25.655698 run osmo-stp_10.42.42.5(pid=2651): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2651)] 18:48:25.791559 run osmo-stp_10.42.42.5(pid=2651): stdout: | (launched: 2022-12-09_18:48:24.389752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:25.927692 run osmo-stp_10.42.42.5(pid=2651): stderr: | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184824584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:26.063601 run osmo-stp_10.42.42.5(pid=2651): stdout: | (launched: 2022-12-09_18:48:24.389752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:26.191689 run osmo-stp_10.42.42.5(pid=2651): stderr: | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184824583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184824584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:26.345298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2651): Process ended prematurely: osmo-stp_10.42.42.5(pid=2651) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2651)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:48:26.354637 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:48:26.382714 run osmo-hlr_10.42.42.2(pid=2648): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2648)] 18:48:26.432584 run osmo-hlr_10.42.42.2(pid=2648): stdout: | (launched: 2022-12-09_18:48:23.387435) 18:48:26.483967 run osmo-hlr_10.42.42.2(pid=2648): stderr: | [0;m[1;31m20221209184823586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184823586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184823586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184823587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184823587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184823587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184823603 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184823611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184823611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184823611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:26.555448 run osmo-msc_10.42.42.6(pid=2654): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2654)] 18:48:26.605205 run osmo-msc_10.42.42.6(pid=2654): stdout: | (launched: 2022-12-09_18:48:25.417548) 18:48:26.656353 run osmo-msc_10.42.42.6(pid=2654): stderr: | [0;m[38;5;43m20221209184825742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184825742 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd11177c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184825742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184825742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184825742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184825743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184825744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184825745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184825745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184825745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:26.707890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2647): Terminating (SIGTERM) 18:48:26.749166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2650): Terminating (SIGTERM) 18:48:26.791092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2653): Terminating (SIGTERM) 18:48:26.832541 --- ParallelTerminationStrategy: PID 2647 died... 18:48:26.852200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2647): Terminated: ok {rc=0} 18:48:26.898532 --- ParallelTerminationStrategy: PID 2650 died... 18:48:26.917693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2650): Terminated: ok {rc=0} 18:48:26.963614 --- ParallelTerminationStrategy: PID 2653 died... 18:48:26.982801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2653): Terminated: ok {rc=0} 18:48:27.070327 bus /sierra_3: Setting Powered False 18:48:28.164415 bus /sierra_3: Setting Powered False 18:48:29.277297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:48:30.420820 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:30.432121 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:48:30.487702 tst mo_mt_call_osmux.py: using LAC 22996 18:48:30.607489 tst mo_mt_call_osmux.py: using RAC 46 18:48:30.725714 tst mo_mt_call_osmux.py: using CellId 22996 18:48:30.855050 tst mo_mt_call_osmux.py: using BVCI 22997 18:48:30.991120 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:31.003476 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:31.015617 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:31.027700 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:31.042131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:48:31.056188 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:48:31.175422 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:48:31.297436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:31.828108 run create_hlr_db(pid=2656): Launched 18:48:31.990772 bus /sierra_2: Setting Powered False 18:48:33.053624 run create_hlr_db(pid=2656): Terminated: ok {rc=0} 18:48:33.503068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2658): Launched 18:48:33.825507 run osmo-hlr_10.42.42.2(pid=2659): Launched 18:48:33.948651 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:34.505633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2661): Launched 18:48:34.827688 run osmo-stp_10.42.42.5(pid=2662): Launched 18:48:34.951003 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:35.533993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2664): Launched 18:48:35.856416 run osmo-msc_10.42.42.6(pid=2665): Launched 18:48:36.036766 run osmo-stp_10.42.42.5(pid=2662): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2662)] 18:48:36.177845 run osmo-stp_10.42.42.5(pid=2662): stdout: | (launched: 2022-12-09_18:48:34.768297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:36.310326 run osmo-stp_10.42.42.5(pid=2662): stderr: | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184834966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:36.443720 run osmo-stp_10.42.42.5(pid=2662): stdout: | (launched: 2022-12-09_18:48:34.768297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:36.572170 run osmo-stp_10.42.42.5(pid=2662): stderr: | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184834965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184834966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184834966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:36.725580 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2662): Process ended prematurely: osmo-stp_10.42.42.5(pid=2662) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2662)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:48:36.734990 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:48:36.762673 run osmo-hlr_10.42.42.2(pid=2659): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2659)] 18:48:36.811983 run osmo-hlr_10.42.42.2(pid=2659): stdout: | (launched: 2022-12-09_18:48:33.766593) 18:48:36.863063 run osmo-hlr_10.42.42.2(pid=2659): stderr: | [0;m[1;31m20221209184833967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184833967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184833967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184833968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184833968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184833968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184833979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184833987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184833988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184833988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:36.933963 run osmo-msc_10.42.42.6(pid=2665): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2665)] 18:48:36.983709 run osmo-msc_10.42.42.6(pid=2665): stdout: | (launched: 2022-12-09_18:48:35.797300) 18:48:37.034636 run osmo-msc_10.42.42.6(pid=2665): stderr: | [0;m[38;5;43m20221209184836119 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184836120 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8366ea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184836120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184836120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184836120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184836120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184836124 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184836124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184836124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184836124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:37.085977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2658): Terminating (SIGTERM) 18:48:37.126626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2661): Terminating (SIGTERM) 18:48:37.167413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2664): Terminating (SIGTERM) 18:48:37.208578 --- ParallelTerminationStrategy: PID 2658 died... 18:48:37.228149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2658): Terminated: ok {rc=0} 18:48:37.273567 --- ParallelTerminationStrategy: PID 2661 died... 18:48:37.292503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2661): Terminated: ok {rc=0} 18:48:37.338094 --- ParallelTerminationStrategy: PID 2664 died... 18:48:37.357113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2664): Terminated: ok {rc=0} 18:48:37.442223 bus /sierra_3: Setting Powered False 18:48:38.539371 bus /sierra_3: Setting Powered False 18:48:39.652551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:48:40.880566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:40.886783 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:48:40.907060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:48:40.932874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:48:40.983550 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:48:41.003663 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:48:41.029522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:48:41.578818 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:48:41.626977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:41.637874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:48:41.696533 tst mo_mt_call.py: using LAC 22997 18:48:41.823946 tst mo_mt_call.py: using RAC 47 18:48:41.949504 tst mo_mt_call.py: using CellId 22997 18:48:42.067285 tst mo_mt_call.py: using BVCI 22998 18:48:42.185397 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:42.196932 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:42.208026 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:42.219284 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:42.230702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:42.242105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:48:42.357448 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:48:42.476682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:42.981206 run create_hlr_db(pid=2670): Launched 18:48:43.103426 bus /sierra_2: Setting Powered False 18:48:44.167091 run create_hlr_db(pid=2670): Terminated: ok {rc=0} 18:48:44.616308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2672): Launched 18:48:44.938824 run osmo-hlr_10.42.42.2(pid=2673): Launched 18:48:45.062517 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:45.620705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2675): Launched 18:48:45.949370 run osmo-stp_10.42.42.5(pid=2676): Launched 18:48:46.116586 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:47.078300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2678): Launched 18:48:47.423282 run osmo-msc_10.42.42.6(pid=2679): Launched 18:48:47.592441 run osmo-stp_10.42.42.5(pid=2676): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2676)] 18:48:47.720281 run osmo-stp_10.42.42.5(pid=2676): stdout: | (launched: 2022-12-09_18:48:45.884802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:47.846438 run osmo-stp_10.42.42.5(pid=2676): stderr: | [0;m[38;5;43m20221209184846338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184846339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184846341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184846344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184846346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184846347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184846347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:47.971741 run osmo-stp_10.42.42.5(pid=2676): stdout: | (launched: 2022-12-09_18:48:45.884802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:48.091069 run osmo-stp_10.42.42.5(pid=2676): stderr: | [0;m[38;5;43m20221209184846338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184846339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184846341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184846344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184846346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184846347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184846347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:48.234540 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2676): Process ended prematurely: osmo-stp_10.42.42.5(pid=2676) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2676)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:48:48.243401 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 18:48:48.269279 run osmo-hlr_10.42.42.2(pid=2673): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2673)] 18:48:48.315609 run osmo-hlr_10.42.42.2(pid=2673): stdout: | (launched: 2022-12-09_18:48:44.879848) 18:48:48.363647 run osmo-hlr_10.42.42.2(pid=2673): stderr: | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184845076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184845087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184845095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184845095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184845096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:48.430689 run osmo-msc_10.42.42.6(pid=2679): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2679)] 18:48:48.477163 run osmo-msc_10.42.42.6(pid=2679): stdout: | (launched: 2022-12-09_18:48:47.367666) 18:48:48.524875 run osmo-msc_10.42.42.6(pid=2679): stderr: | [0;m[38;5;43m20221209184847639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184847640 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4695264c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184847640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184847640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184847640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184847640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184847643 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184847643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184847643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184847644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:48.573179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2672): Terminating (SIGTERM) 18:48:48.612160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2675): Terminating (SIGTERM) 18:48:48.650841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2678): Terminating (SIGTERM) 18:48:48.690306 --- ParallelTerminationStrategy: PID 2672 died... 18:48:48.708621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2672): Terminated: ok {rc=0} 18:48:48.751657 --- ParallelTerminationStrategy: PID 2675 died... 18:48:48.769654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2675): Terminated: ok {rc=0} 18:48:48.811970 --- ParallelTerminationStrategy: PID 2678 died... 18:48:48.829947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2678): Terminated: ok {rc=0} 18:48:48.911734 bus /sierra_3: Setting Powered False 18:48:50.007308 bus /sierra_3: Setting Powered False 18:48:51.121013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:48:52.267842 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.279595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:48:52.336851 tst mo_mt_call_osmux.py: using LAC 22998 18:48:52.464688 tst mo_mt_call_osmux.py: using RAC 48 18:48:52.592086 tst mo_mt_call_osmux.py: using CellId 22998 18:48:52.712828 tst mo_mt_call_osmux.py: using BVCI 22999 18:48:52.822960 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.834005 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.844777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.855585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.866152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:48:52.876681 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:48:52.994652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:48:53.112913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:53.613019 run create_hlr_db(pid=2681): Launched 18:48:53.735470 bus /sierra_2: Setting Powered False 18:48:54.799209 run create_hlr_db(pid=2681): Terminated: ok {rc=0} 18:48:55.229201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2683): Launched 18:48:55.529128 run osmo-hlr_10.42.42.2(pid=2684): Launched 18:48:55.643387 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:56.159980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2686): Launched 18:48:56.459553 run osmo-stp_10.42.42.5(pid=2687): Launched 18:48:56.574097 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:57.117603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2689): Launched 18:48:57.417942 run osmo-msc_10.42.42.6(pid=2690): Launched 18:48:57.586708 run osmo-stp_10.42.42.5(pid=2687): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2687)] 18:48:57.713133 run osmo-stp_10.42.42.5(pid=2687): stdout: | (launched: 2022-12-09_18:48:56.403866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:57.839418 run osmo-stp_10.42.42.5(pid=2687): stderr: | [0;m[38;5;43m20221209184856574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184856575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184856575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184856575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:57.964271 run osmo-stp_10.42.42.5(pid=2687): stdout: | (launched: 2022-12-09_18:48:56.403866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:58.083636 run osmo-stp_10.42.42.5(pid=2687): stderr: | [0;m[38;5;43m20221209184856574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184856575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184856575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184856575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184856576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:58.226925 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2687): Process ended prematurely: osmo-stp_10.42.42.5(pid=2687) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2687)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:48:58.235762 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:48:58.261778 run osmo-hlr_10.42.42.2(pid=2684): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2684)] 18:48:58.308062 run osmo-hlr_10.42.42.2(pid=2684): stdout: | (launched: 2022-12-09_18:48:55.473457) 18:48:58.355853 run osmo-hlr_10.42.42.2(pid=2684): stderr: | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184855650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184855663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184855672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184855672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184855672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:58.422516 run osmo-msc_10.42.42.6(pid=2690): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2690)] 18:48:58.468561 run osmo-msc_10.42.42.6(pid=2690): stdout: | (launched: 2022-12-09_18:48:57.361850) 18:48:58.516168 run osmo-msc_10.42.42.6(pid=2690): stderr: | [0;m[38;5;43m20221209184857634 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184857634 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f67c9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184857634 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184857634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184857634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184857635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184857639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184857639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184857639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184857639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:58.564396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2683): Terminating (SIGTERM) 18:48:58.602687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2686): Terminating (SIGTERM) 18:48:58.640941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2689): Terminating (SIGTERM) 18:48:58.680006 --- ParallelTerminationStrategy: PID 2683 died... 18:48:58.698890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2683): Terminated: ok {rc=0} 18:48:58.741644 --- ParallelTerminationStrategy: PID 2686 died... 18:48:58.759795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2686): Terminated: ok {rc=0} 18:48:58.802418 --- ParallelTerminationStrategy: PID 2689 died... 18:48:58.820528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2689): Terminated: ok {rc=0} 18:48:58.901204 bus /sierra_3: Setting Powered False 18:48:59.996214 bus /sierra_3: Setting Powered False 18:49:01.110619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:49:02.343256 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:02.350193 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:49:02.370923 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:49:02.396778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:49:02.446720 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:49:02.467009 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:49:02.492595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:49:03.043118 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:49:03.091472 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.102304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:49:03.158017 tst mo_mt_call.py: using LAC 22999 18:49:03.276468 tst mo_mt_call.py: using RAC 49 18:49:03.395768 tst mo_mt_call.py: using CellId 22999 18:49:03.514563 tst mo_mt_call.py: using BVCI 23000 18:49:03.624855 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.635751 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.646447 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.656922 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.667526 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:03.678155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:49:03.792927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:49:03.913482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:04.414487 run create_hlr_db(pid=2695): Launched 18:49:04.537513 bus /sierra_2: Setting Powered False 18:49:05.601205 run create_hlr_db(pid=2695): Terminated: ok {rc=0} 18:49:06.032900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Launched 18:49:06.334479 run osmo-hlr_10.42.42.2(pid=2698): Launched 18:49:06.448374 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:06.969429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Launched 18:49:07.269491 run osmo-stp_10.42.42.5(pid=2701): Launched 18:49:07.383749 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:07.926243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Launched 18:49:08.225955 run osmo-msc_10.42.42.6(pid=2704): Launched 18:49:08.392535 run osmo-stp_10.42.42.5(pid=2701): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] 18:49:08.519398 run osmo-stp_10.42.42.5(pid=2701): stdout: | (launched: 2022-12-09_18:49:07.214235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:08.645983 run osmo-stp_10.42.42.5(pid=2701): stderr: | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184907387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:08.771640 run osmo-stp_10.42.42.5(pid=2701): stdout: | (launched: 2022-12-09_18:49:07.214235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:08.891314 run osmo-stp_10.42.42.5(pid=2701): stderr: | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184907386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184907387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184907387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:09.034966 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2701): Process ended prematurely: osmo-stp_10.42.42.5(pid=2701) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:49:09.043739 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:49:09.070601 run osmo-hlr_10.42.42.2(pid=2698): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2698)] 18:49:09.118213 run osmo-hlr_10.42.42.2(pid=2698): stdout: | (launched: 2022-12-09_18:49:06.279184) 18:49:09.167048 run osmo-hlr_10.42.42.2(pid=2698): stderr: | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184906454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184906467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184906476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184906476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184906476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:09.234785 run osmo-msc_10.42.42.6(pid=2704): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2704)] 18:49:09.281586 run osmo-msc_10.42.42.6(pid=2704): stdout: | (launched: 2022-12-09_18:49:08.170708) 18:49:09.329459 run osmo-msc_10.42.42.6(pid=2704): stderr: | [0;m[38;5;43m20221209184908445 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184908445 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71c7cc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184908445 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184908445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184908445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184908446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184908447 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184908448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184908448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184908448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:09.377782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Terminating (SIGTERM) 18:49:09.416146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Terminating (SIGTERM) 18:49:09.454723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Terminating (SIGTERM) 18:49:09.493633 --- ParallelTerminationStrategy: PID 2697 died... 18:49:09.512038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Terminated: ok {rc=0} 18:49:09.555091 --- ParallelTerminationStrategy: PID 2700 died... 18:49:09.573268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Terminated: ok {rc=0} 18:49:09.615889 --- ParallelTerminationStrategy: PID 2703 died... 18:49:09.633875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Terminated: ok {rc=0} 18:49:09.717070 bus /sierra_3: Setting Powered False 18:49:10.815145 bus /sierra_3: Setting Powered False 18:49:11.929018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:49:13.074042 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.085478 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:49:13.140862 tst mo_mt_call_osmux.py: using LAC 23000 18:49:13.260295 tst mo_mt_call_osmux.py: using RAC 50 18:49:13.378071 tst mo_mt_call_osmux.py: using CellId 23000 18:49:13.496242 tst mo_mt_call_osmux.py: using BVCI 23001 18:49:13.606645 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.617489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.628028 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.638667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.649361 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:49:13.659876 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:49:13.772905 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:49:13.891667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:14.394958 run create_hlr_db(pid=2706): Launched 18:49:14.518220 bus /sierra_2: Setting Powered False 18:49:15.582188 run create_hlr_db(pid=2706): Terminated: ok {rc=0} 18:49:16.051727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Launched 18:49:16.400477 run osmo-hlr_10.42.42.2(pid=2709): Launched 18:49:16.657745 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:17.402711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Launched 18:49:17.724439 run osmo-stp_10.42.42.5(pid=2712): Launched 18:49:17.846886 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:18.429102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Launched 18:49:18.752205 run osmo-msc_10.42.42.6(pid=2715): Launched 18:49:18.931258 run osmo-stp_10.42.42.5(pid=2712): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] 18:49:19.067579 run osmo-stp_10.42.42.5(pid=2712): stdout: | (launched: 2022-12-09_18:49:17.665457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:19.203829 run osmo-stp_10.42.42.5(pid=2712): stderr: | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184917860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:19.339676 run osmo-stp_10.42.42.5(pid=2712): stdout: | (launched: 2022-12-09_18:49:17.665457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:19.468295 run osmo-stp_10.42.42.5(pid=2712): stderr: | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184917859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184917860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184917860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:19.622126 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2712): Process ended prematurely: osmo-stp_10.42.42.5(pid=2712) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:49:19.631384 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:49:19.658984 run osmo-hlr_10.42.42.2(pid=2709): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2709)] 18:49:19.708114 run osmo-hlr_10.42.42.2(pid=2709): stdout: | (launched: 2022-12-09_18:49:16.335271) 18:49:19.758745 run osmo-hlr_10.42.42.2(pid=2709): stderr: | [0;m[1;31m20221209184916633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184916633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184916633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184916633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184916634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184916634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184916649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184916673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184916673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184916673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:19.829523 run osmo-msc_10.42.42.6(pid=2715): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2715)] 18:49:19.878402 run osmo-msc_10.42.42.6(pid=2715): stdout: | (launched: 2022-12-09_18:49:18.692894) 18:49:19.930046 run osmo-msc_10.42.42.6(pid=2715): stderr: | [0;m[38;5;43m20221209184919019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184919019 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7d266a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184919019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184919019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184919019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184919019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184919023 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184919023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184919023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184919024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:19.981404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Terminating (SIGTERM) 18:49:20.022311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Terminating (SIGTERM) 18:49:20.063309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Terminating (SIGTERM) 18:49:20.104352 --- ParallelTerminationStrategy: PID 2708 died... 18:49:20.123836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Terminated: ok {rc=0} 18:49:20.169500 --- ParallelTerminationStrategy: PID 2711 died... 18:49:20.188317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Terminated: ok {rc=0} 18:49:20.234127 --- ParallelTerminationStrategy: PID 2714 died... 18:49:20.253173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Terminated: ok {rc=0} 18:49:20.338850 bus /sierra_3: Setting Powered False 18:49:21.436017 bus /sierra_3: Setting Powered False 18:49:22.549333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:49:23.783197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:23.789976 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:49:23.811543 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:49:23.839109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:49:23.890836 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:49:23.911513 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:49:23.938644 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:49:24.489993 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:49:24.541714 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:24.552823 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:49:24.609405 tst mo_mt_call.py: using LAC 23001 18:49:24.736846 tst mo_mt_call.py: using RAC 51 18:49:24.862836 tst mo_mt_call.py: using CellId 23001 18:49:24.988674 tst mo_mt_call.py: using BVCI 23002 18:49:25.105605 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:25.117046 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:25.128044 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:25.139459 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:25.150949 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:25.162264 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:25.276915 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:25.391773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:25.858465 run create_hlr_db(pid=2720): Launched 18:49:25.983699 bus /sierra_2: Setting Powered False 18:49:27.046966 run create_hlr_db(pid=2720): Terminated: ok {rc=0} 18:49:27.495434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Launched 18:49:27.817247 run osmo-hlr_10.42.42.2(pid=2723): Launched 18:49:27.940636 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:28.498039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Launched 18:49:28.820932 run osmo-stp_10.42.42.5(pid=2726): Launched 18:49:28.944411 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:29.527903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2728): Launched 18:49:29.851312 run osmo-msc_10.42.42.6(pid=2729): Launched 18:49:30.031698 run osmo-stp_10.42.42.5(pid=2726): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2726)] 18:49:30.168061 run osmo-stp_10.42.42.5(pid=2726): stdout: | (launched: 2022-12-09_18:49:28.761799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:30.304637 run osmo-stp_10.42.42.5(pid=2726): stderr: | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184928957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:30.440704 run osmo-stp_10.42.42.5(pid=2726): stdout: | (launched: 2022-12-09_18:49:28.761799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:30.569336 run osmo-stp_10.42.42.5(pid=2726): stderr: | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184928957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184928957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184928958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:30.723638 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2726): Process ended prematurely: osmo-stp_10.42.42.5(pid=2726) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2726)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:49:30.733065 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:49:30.760469 run osmo-hlr_10.42.42.2(pid=2723): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2723)] 18:49:30.810020 run osmo-hlr_10.42.42.2(pid=2723): stdout: | (launched: 2022-12-09_18:49:27.758326) 18:49:30.869552 run osmo-hlr_10.42.42.2(pid=2723): stderr: | [0;m[1;31m20221209184927958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184927958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184927958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184927958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184927958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184927959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184927971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184927980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184927980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184927980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:30.942553 run osmo-msc_10.42.42.6(pid=2729): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2729)] 18:49:30.993659 run osmo-msc_10.42.42.6(pid=2729): stdout: | (launched: 2022-12-09_18:49:29.792204) 18:49:31.046040 run osmo-msc_10.42.42.6(pid=2729): stderr: | [0;m[38;5;43m20221209184930115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184930115 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30b5f0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184930115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184930115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184930116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184930116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184930117 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184930118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184930118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184930118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:31.099161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Terminating (SIGTERM) 18:49:31.141770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Terminating (SIGTERM) 18:49:31.184414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2728): Terminating (SIGTERM) 18:49:31.227409 --- ParallelTerminationStrategy: PID 2722 died... 18:49:31.247678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Terminated: ok {rc=0} 18:49:31.295610 --- ParallelTerminationStrategy: PID 2725 died... 18:49:31.315844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Terminated: ok {rc=0} 18:49:31.363281 --- ParallelTerminationStrategy: PID 2728 died... 18:49:31.383314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2728): Terminated: ok {rc=0} 18:49:31.473275 bus /sierra_3: Setting Powered False 18:49:32.571432 bus /sierra_3: Setting Powered False 18:49:33.687457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:49:34.831337 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:34.842935 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:49:34.898801 tst mo_mt_call_osmux.py: using LAC 23002 18:49:35.020402 tst mo_mt_call_osmux.py: using RAC 52 18:49:35.139897 tst mo_mt_call_osmux.py: using CellId 23002 18:49:35.262815 tst mo_mt_call_osmux.py: using BVCI 23003 18:49:35.372834 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:35.383724 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:35.394272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:35.404779 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:35.415348 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:35.425973 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:35.539335 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:35.654955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:36.156735 run create_hlr_db(pid=2731): Launched 18:49:36.279616 bus /sierra_2: Setting Powered False 18:49:37.344136 run create_hlr_db(pid=2731): Terminated: ok {rc=0} 18:49:37.792694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Launched 18:49:38.115874 run osmo-hlr_10.42.42.2(pid=2734): Launched 18:49:38.238703 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:38.796808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Launched 18:49:39.120265 run osmo-stp_10.42.42.5(pid=2737): Launched 18:49:39.243044 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:39.829028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2739): Launched 18:49:40.151660 run osmo-msc_10.42.42.6(pid=2740): Launched 18:49:40.331617 run osmo-stp_10.42.42.5(pid=2737): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] 18:49:40.469585 run osmo-stp_10.42.42.5(pid=2737): stdout: | (launched: 2022-12-09_18:49:39.060710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:40.606102 run osmo-stp_10.42.42.5(pid=2737): stderr: | [0;m[38;5;43m20221209184939253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184939253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184939254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184939254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184939254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184939255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184939255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:40.741934 run osmo-stp_10.42.42.5(pid=2737): stdout: | (launched: 2022-12-09_18:49:39.060710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:40.870599 run osmo-stp_10.42.42.5(pid=2737): stderr: | [0;m[38;5;43m20221209184939253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184939253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184939254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184939254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184939254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184939255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184939255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:41.025600 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2737): Process ended prematurely: osmo-stp_10.42.42.5(pid=2737) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:49:41.034908 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:49:41.062596 run osmo-hlr_10.42.42.2(pid=2734): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2734)] 18:49:41.111983 run osmo-hlr_10.42.42.2(pid=2734): stdout: | (launched: 2022-12-09_18:49:38.056376) 18:49:41.162752 run osmo-hlr_10.42.42.2(pid=2734): stderr: | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184938255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184938267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184938275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184938275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184938276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:41.233784 run osmo-msc_10.42.42.6(pid=2740): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2740)] 18:49:41.282947 run osmo-msc_10.42.42.6(pid=2740): stdout: | (launched: 2022-12-09_18:49:40.092367) 18:49:41.334205 run osmo-msc_10.42.42.6(pid=2740): stderr: | [0;m[38;5;43m20221209184940418 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184940418 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e0ea7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184940418 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184940418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184940418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184940419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184940420 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184940421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184940421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184940421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:41.385550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Terminating (SIGTERM) 18:49:41.426459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Terminating (SIGTERM) 18:49:41.467318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2739): Terminating (SIGTERM) 18:49:41.508555 --- ParallelTerminationStrategy: PID 2733 died... 18:49:41.528225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Terminated: ok {rc=0} 18:49:41.574127 --- ParallelTerminationStrategy: PID 2736 died... 18:49:41.593298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Terminated: ok {rc=0} 18:49:41.638864 --- ParallelTerminationStrategy: PID 2739 died... 18:49:41.658030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2739): Terminated: ok {rc=0} 18:49:41.744494 bus /sierra_3: Setting Powered False 18:49:42.841295 bus /sierra_3: Setting Powered False 18:49:43.956389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:49:45.189197 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:45.195275 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:49:45.215333 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:49:45.241006 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:49:45.291032 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:49:45.310952 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:49:45.336544 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:49:45.902492 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:49:45.952118 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:45.963924 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:49:46.019760 tst mo_mt_call.py: using LAC 23003 18:49:46.139071 tst mo_mt_call.py: using RAC 53 18:49:46.274436 tst mo_mt_call.py: using CellId 23003 18:49:46.396557 tst mo_mt_call.py: using BVCI 23004 18:49:46.517982 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:46.530434 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:46.542617 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:46.556495 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:46.570056 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:46.583327 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:49:46.707556 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:49:46.861311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:47.350296 run create_hlr_db(pid=2745): Launched 18:49:47.472561 bus /sierra_2: Setting Powered False 18:49:48.532466 run create_hlr_db(pid=2745): Terminated: ok {rc=0} 18:49:48.973244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2747): Launched 18:49:49.295247 run osmo-hlr_10.42.42.2(pid=2748): Launched 18:49:49.418564 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:49.974688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2750): Launched 18:49:50.297561 run osmo-stp_10.42.42.5(pid=2751): Launched 18:49:50.421445 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:51.004591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2753): Launched 18:49:51.326986 run osmo-msc_10.42.42.6(pid=2754): Launched 18:49:51.506721 run osmo-stp_10.42.42.5(pid=2751): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2751)] 18:49:51.642848 run osmo-stp_10.42.42.5(pid=2751): stdout: | (launched: 2022-12-09_18:49:50.238493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:51.780267 run osmo-stp_10.42.42.5(pid=2751): stderr: | [0;m[38;5;43m20221209184950431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184950431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184950432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184950432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:51.916160 run osmo-stp_10.42.42.5(pid=2751): stdout: | (launched: 2022-12-09_18:49:50.238493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:52.045749 run osmo-stp_10.42.42.5(pid=2751): stderr: | [0;m[38;5;43m20221209184950431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209184950431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209184950432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209184950432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209184950433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:52.199587 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2751): Process ended prematurely: osmo-stp_10.42.42.5(pid=2751) [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2751)] [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:49:52.209157 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:49:52.237105 run osmo-hlr_10.42.42.2(pid=2748): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2748)] 18:49:52.286268 run osmo-hlr_10.42.42.2(pid=2748): stdout: | (launched: 2022-12-09_18:49:49.236468) 18:49:52.337145 run osmo-hlr_10.42.42.2(pid=2748): stderr: | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184949435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184949447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184949456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184949456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184949456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:52.407745 run osmo-msc_10.42.42.6(pid=2754): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2754)] 18:49:52.457071 run osmo-msc_10.42.42.6(pid=2754): stdout: | (launched: 2022-12-09_18:49:51.267822) 18:49:52.507456 run osmo-msc_10.42.42.6(pid=2754): stderr: | [0;m[38;5;43m20221209184951590 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209184951590 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0480fb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209184951591 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209184951591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209184951591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209184951591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209184951593 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209184951593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209184951593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209184951593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:52.558502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2747): Terminating (SIGTERM) 18:49:52.599544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2750): Terminating (SIGTERM) 18:49:52.640461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2753): Terminating (SIGTERM) 18:49:52.681748 --- ParallelTerminationStrategy: PID 2747 died... 18:49:52.701307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2747): Terminated: ok {rc=0} 18:49:52.746935 --- ParallelTerminationStrategy: PID 2750 died... 18:49:52.766086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2750): Terminated: ok {rc=0} 18:49:52.812170 --- ParallelTerminationStrategy: PID 2753 died... 18:49:52.831426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2753): Terminated: ok {rc=0} 18:49:52.917259 bus /sierra_3: Setting Powered False 18:49:54.016745 bus /sierra_3: Setting Powered False 18:49:55.131848 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:49:56.278703 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.290681 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:49:56.349405 tst mo_mt_call_osmux.py: using LAC 23004 18:49:56.478045 tst mo_mt_call_osmux.py: using RAC 54 18:49:56.604103 tst mo_mt_call_osmux.py: using CellId 23004 18:49:56.733044 tst mo_mt_call_osmux.py: using BVCI 23005 18:49:56.851512 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.862831 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.874081 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.885435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.896714 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:49:56.908181 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:49:57.029435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:49:57.148149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:57.649719 run create_hlr_db(pid=2756): Launched 18:49:57.772275 bus /sierra_2: Setting Powered False 18:49:58.834143 run create_hlr_db(pid=2756): Terminated: ok {rc=0} 18:49:59.265986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2758): Launched 18:49:59.566360 run osmo-hlr_10.42.42.2(pid=2759): Launched 18:49:59.680153 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:00.195857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2761): Launched 18:50:00.495810 run osmo-stp_10.42.42.5(pid=2762): Launched 18:50:00.609564 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:01.185939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2767): Launched 18:50:01.505669 run osmo-msc_10.42.42.6(pid=2768): Launched 18:50:01.837745 run osmo-stp_10.42.42.5(pid=2762): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2762)] 18:50:01.976840 run osmo-stp_10.42.42.5(pid=2762): stdout: | (launched: 2022-12-09_18:50:00.440447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:02.257700 run osmo-stp_10.42.42.5(pid=2762): stderr: | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185000615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:02.431249 run osmo-stp_10.42.42.5(pid=2762): stdout: | (launched: 2022-12-09_18:50:00.440447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:02.551064 run osmo-stp_10.42.42.5(pid=2762): stderr: | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185000614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185000615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185000615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:02.694850 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2762): Process ended prematurely: osmo-stp_10.42.42.5(pid=2762) [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2762)] [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:50:02.703503 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:50:02.729607 run osmo-hlr_10.42.42.2(pid=2759): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2759)] 18:50:02.775908 run osmo-hlr_10.42.42.2(pid=2759): stdout: | (launched: 2022-12-09_18:49:59.510391) 18:50:02.823879 run osmo-hlr_10.42.42.2(pid=2759): stderr: | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209184959690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209184959706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209184959715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209184959716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209184959716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:02.891061 run osmo-msc_10.42.42.6(pid=2768): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2768)] 18:50:02.937492 run osmo-msc_10.42.42.6(pid=2768): stdout: | (launched: 2022-12-09_18:50:01.439781) 18:50:02.985323 run osmo-msc_10.42.42.6(pid=2768): stderr: | [0;m[38;5;43m20221209185002063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185002065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f246c224c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185002065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185002066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185002066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185002069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185002076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185002079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185002079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185002079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:03.033749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2758): Terminating (SIGTERM) 18:50:03.072192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2761): Terminating (SIGTERM) 18:50:03.110680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2767): Terminating (SIGTERM) 18:50:03.149595 --- ParallelTerminationStrategy: PID 2758 died... 18:50:03.168092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2758): Terminated: ok {rc=0} 18:50:03.211717 --- ParallelTerminationStrategy: PID 2761 died... 18:50:03.230008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2761): Terminated: ok {rc=0} 18:50:03.272698 --- ParallelTerminationStrategy: PID 2767 died... 18:50:03.290914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2767): Terminated: ok {rc=0} 18:50:03.374919 bus /sierra_3: Setting Powered False 18:50:04.473367 bus /sierra_3: Setting Powered False 18:50:05.587021 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:50:06.821703 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:06.827615 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:50:06.848524 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:50:06.876190 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:50:06.930758 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:50:06.952251 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:50:06.978189 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:50:07.524625 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:50:07.574544 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:07.586491 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:50:07.642506 tst mo_mt_call.py: using LAC 23005 18:50:07.760609 tst mo_mt_call.py: using RAC 55 18:50:07.878553 tst mo_mt_call.py: using CellId 23005 18:50:07.998484 tst mo_mt_call.py: using BVCI 23006 18:50:08.109398 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:08.120368 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:08.131033 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:08.141711 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:08.152253 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:08.162835 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:50:08.280312 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:50:08.394262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:08.896677 run create_hlr_db(pid=2775): Launched 18:50:09.019543 bus /sierra_2: Setting Powered False 18:50:10.079220 run create_hlr_db(pid=2775): Terminated: ok {rc=0} 18:50:10.509337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Launched 18:50:10.810924 run osmo-hlr_10.42.42.2(pid=2778): Launched 18:50:10.925168 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:11.443006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Launched 18:50:11.744512 run osmo-stp_10.42.42.5(pid=2781): Launched 18:50:11.858912 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:12.404035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Launched 18:50:12.706024 run osmo-msc_10.42.42.6(pid=2784): Launched 18:50:12.873443 run osmo-stp_10.42.42.5(pid=2781): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] 18:50:13.000546 run osmo-stp_10.42.42.5(pid=2781): stdout: | (launched: 2022-12-09_18:50:11.688528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:13.127032 run osmo-stp_10.42.42.5(pid=2781): stderr: | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185011863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:13.251753 run osmo-stp_10.42.42.5(pid=2781): stdout: | (launched: 2022-12-09_18:50:11.688528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:13.371769 run osmo-stp_10.42.42.5(pid=2781): stderr: | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185011863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185011863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185011864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:13.514728 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2781): Process ended prematurely: osmo-stp_10.42.42.5(pid=2781) [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:50:13.523363 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:50:13.549167 run osmo-hlr_10.42.42.2(pid=2778): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2778)] 18:50:13.595263 run osmo-hlr_10.42.42.2(pid=2778): stdout: | (launched: 2022-12-09_18:50:10.755143) 18:50:13.643001 run osmo-hlr_10.42.42.2(pid=2778): stderr: | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185010930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185010942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185010951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185010951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185010951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:13.709964 run osmo-msc_10.42.42.6(pid=2784): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2784)] 18:50:13.755987 run osmo-msc_10.42.42.6(pid=2784): stdout: | (launched: 2022-12-09_18:50:12.649986) 18:50:13.803847 run osmo-msc_10.42.42.6(pid=2784): stderr: | [0;m[38;5;43m20221209185012923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185012924 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff88b34cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185012924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185012924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185012924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185012924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185012926 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185012926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185012926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185012927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:13.852184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Terminating (SIGTERM) 18:50:13.890555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Terminating (SIGTERM) 18:50:13.928888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Terminating (SIGTERM) 18:50:13.967740 --- ParallelTerminationStrategy: PID 2777 died... 18:50:13.986374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Terminated: ok {rc=0} 18:50:14.029144 --- ParallelTerminationStrategy: PID 2780 died... 18:50:14.047332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Terminated: ok {rc=0} 18:50:14.090422 --- ParallelTerminationStrategy: PID 2783 died... 18:50:14.108755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Terminated: ok {rc=0} 18:50:14.190647 bus /sierra_3: Setting Powered False 18:50:15.285959 bus /sierra_3: Setting Powered False 18:50:16.406476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:50:17.566676 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:17.578526 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:50:17.637802 tst mo_mt_call_osmux.py: using LAC 23006 18:50:17.761337 tst mo_mt_call_osmux.py: using RAC 56 18:50:17.878214 tst mo_mt_call_osmux.py: using CellId 23006 18:50:17.994178 tst mo_mt_call_osmux.py: using BVCI 23007 18:50:18.104051 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:18.114760 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:18.125312 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:18.135687 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:18.146102 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:50:18.156549 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:50:18.269580 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:50:18.388004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:18.889431 run create_hlr_db(pid=2786): Launched 18:50:19.012713 bus /sierra_2: Setting Powered False 18:50:20.077063 run create_hlr_db(pid=2786): Terminated: ok {rc=0} 18:50:20.526421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2788): Launched 18:50:20.849589 run osmo-hlr_10.42.42.2(pid=2789): Launched 18:50:20.972876 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:21.527539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2791): Launched 18:50:21.850100 run osmo-stp_10.42.42.5(pid=2792): Launched 18:50:21.973248 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:22.561954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2794): Launched 18:50:22.885331 run osmo-msc_10.42.42.6(pid=2795): Launched 18:50:23.066252 run osmo-stp_10.42.42.5(pid=2792): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2792)] 18:50:23.201870 run osmo-stp_10.42.42.5(pid=2792): stdout: | (launched: 2022-12-09_18:50:21.790887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:23.338364 run osmo-stp_10.42.42.5(pid=2792): stderr: | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185021985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:23.474041 run osmo-stp_10.42.42.5(pid=2792): stdout: | (launched: 2022-12-09_18:50:21.790887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:23.602914 run osmo-stp_10.42.42.5(pid=2792): stderr: | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185021984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185021985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185021985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:23.757281 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2792): Process ended prematurely: osmo-stp_10.42.42.5(pid=2792) [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2792)] [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:50:23.766922 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:50:23.795023 run osmo-hlr_10.42.42.2(pid=2789): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2789)] 18:50:23.844501 run osmo-hlr_10.42.42.2(pid=2789): stdout: | (launched: 2022-12-09_18:50:20.790430) 18:50:23.895742 run osmo-hlr_10.42.42.2(pid=2789): stderr: | [0;m[1;31m20221209185020989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185020989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185020989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185020990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185020990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185020990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185021001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185021010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185021010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185021010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:23.967220 run osmo-msc_10.42.42.6(pid=2795): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2795)] 18:50:24.017213 run osmo-msc_10.42.42.6(pid=2795): stdout: | (launched: 2022-12-09_18:50:22.826201) 18:50:24.068375 run osmo-msc_10.42.42.6(pid=2795): stderr: | [0;m[38;5;43m20221209185023147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185023147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac5438fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185023147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185023147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185023147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185023148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185023149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185023150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185023150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185023150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:24.119965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2788): Terminating (SIGTERM) 18:50:24.161144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2791): Terminating (SIGTERM) 18:50:24.202466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2794): Terminating (SIGTERM) 18:50:24.243958 --- ParallelTerminationStrategy: PID 2788 died... 18:50:24.263842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2788): Terminated: ok {rc=0} 18:50:24.310050 --- ParallelTerminationStrategy: PID 2791 died... 18:50:24.329475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2791): Terminated: ok {rc=0} 18:50:24.375157 --- ParallelTerminationStrategy: PID 2794 died... 18:50:24.394377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2794): Terminated: ok {rc=0} 18:50:24.481144 bus /sierra_3: Setting Powered False 18:50:25.580147 bus /sierra_3: Setting Powered False 18:50:26.695054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:oc2g --------------------------------------------------------------------- 18:50:27.926350 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:27.931341 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 18:50:27.951542 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 18:50:27.977428 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 18:50:28.060940 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 18:50:28.081067 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 18:50:28.106948 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 18:50:28.689766 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 18:50:28.694611 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:28.704906 tst emergency:oc2g: Using 1 x bts (candidates: 1) 18:50:28.739895 tst emergency_mo_mt_call.py: using LAC 23007 18:50:28.856099 tst emergency_mo_mt_call.py: using RAC 57 18:50:28.983374 tst emergency_mo_mt_call.py: using CellId 23007 18:50:29.110791 tst emergency_mo_mt_call.py: using BVCI 23008 18:50:29.226881 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:29.237898 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:29.248789 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:29.260293 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:29.271763 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:29.283152 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:29.398668 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:29.515516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:30.011984 run create_hlr_db(pid=2800): Launched 18:50:30.133875 bus /sierra_2: Setting Powered False 18:50:31.216154 run create_hlr_db(pid=2800): Terminated: ok {rc=0} 18:50:31.709942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Launched 18:50:32.032490 run osmo-hlr_10.42.42.2(pid=2803): Launched 18:50:32.263777 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:32.811469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Launched 18:50:33.129524 run osmo-stp_10.42.42.5(pid=2806): Launched 18:50:33.261095 tst emergency_mo_mt_call.py: using MSISDN 7329 18:50:33.426774 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:33.995569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Launched 18:50:34.313450 run osmo-msc_10.42.42.6(pid=2809): Launched 18:50:34.491552 run osmo-stp_10.42.42.5(pid=2806): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] 18:50:34.626038 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-09_18:50:33.071077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:34.761122 run osmo-stp_10.42.42.5(pid=2806): stderr: | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185033265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:34.895196 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-09_18:50:33.071077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:35.023056 run osmo-stp_10.42.42.5(pid=2806): stderr: | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185033264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185033265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185033265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:35.175210 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py:19] 18:50:35.183931 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 18:50:35.211519 run osmo-hlr_10.42.42.2(pid=2803): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2803)] 18:50:35.261376 run osmo-hlr_10.42.42.2(pid=2803): stdout: | (launched: 2022-12-09_18:50:31.961766) 18:50:35.312715 run osmo-hlr_10.42.42.2(pid=2803): stderr: | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185032218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185032238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185032246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185032246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185032246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:35.384134 run osmo-msc_10.42.42.6(pid=2809): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2809)] 18:50:35.433795 run osmo-msc_10.42.42.6(pid=2809): stdout: | (launched: 2022-12-09_18:50:34.254804) 18:50:35.485277 run osmo-msc_10.42.42.6(pid=2809): stderr: | [0;m[38;5;43m20221209185034574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185034575 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd80c6c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185034575 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185034575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185034575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185034575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185034577 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185034577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185034578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185034578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:35.536674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Terminating (SIGTERM) 18:50:35.577862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminating (SIGTERM) 18:50:35.619346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminating (SIGTERM) 18:50:35.661204 --- ParallelTerminationStrategy: PID 2802 died... 18:50:35.680771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Terminated: ok {rc=0} 18:50:35.726953 --- ParallelTerminationStrategy: PID 2805 died... 18:50:35.746270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminated: ok {rc=0} 18:50:35.792158 --- ParallelTerminationStrategy: PID 2808 died... 18:50:35.811582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminated: ok {rc=0} 18:50:35.898362 bus /sierra_3: Setting Powered False 18:50:36.993712 bus /sierra_3: Setting Powered False 18:50:38.106602 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 18:50:39.192099 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.203438 tst emergency:oc2g: Using 1 x bts (candidates: 1) 18:50:39.240942 tst emergency_preemptive_call.py: using LAC 23008 18:50:39.365384 tst emergency_preemptive_call.py: using RAC 58 18:50:39.489133 tst emergency_preemptive_call.py: using CellId 23008 18:50:39.614627 tst emergency_preemptive_call.py: using BVCI 23009 18:50:39.729562 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.740322 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.751109 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.762079 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.773041 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:50:39.783882 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:39.896506 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:40.016078 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:40.130892 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:50:40.248510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:40.744682 run create_hlr_db(pid=2811): Launched 18:50:40.865573 bus /sierra_2: Setting Powered False 18:50:41.929190 run create_hlr_db(pid=2811): Terminated: ok {rc=0} 18:50:42.372805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Launched 18:50:42.691486 run osmo-hlr_10.42.42.2(pid=2814): Launched 18:50:42.813742 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:43.363091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Launched 18:50:43.681860 run osmo-stp_10.42.42.5(pid=2817): Launched 18:50:43.811855 tst emergency_preemptive_call.py: using MSISDN 7330 18:50:43.976130 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:44.547774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Launched 18:50:44.866034 run osmo-msc_10.42.42.6(pid=2820): Launched 18:50:45.043867 run osmo-stp_10.42.42.5(pid=2817): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] 18:50:45.177937 run osmo-stp_10.42.42.5(pid=2817): stdout: | (launched: 2022-12-09_18:50:43.623191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:45.312361 run osmo-stp_10.42.42.5(pid=2817): stderr: | [0;m[38;5;43m20221209185043815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185043815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185043816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185043816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:45.446380 run osmo-stp_10.42.42.5(pid=2817): stdout: | (launched: 2022-12-09_18:50:43.623191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:45.573980 run osmo-stp_10.42.42.5(pid=2817): stderr: | [0;m[38;5;43m20221209185043815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185043815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185043816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185043816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185043817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:45.725795 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2817): Process ended prematurely: osmo-stp_10.42.42.5(pid=2817) [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py:32] 18:50:45.734885 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 18:50:45.762387 run osmo-hlr_10.42.42.2(pid=2814): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2814)] 18:50:45.812301 run osmo-hlr_10.42.42.2(pid=2814): stdout: | (launched: 2022-12-09_18:50:42.632722) 18:50:45.869879 run osmo-hlr_10.42.42.2(pid=2814): stderr: | [0;m[1;31m20221209185042829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185042829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185042829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185042830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185042830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185042830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185042840 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185042848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185042849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185042849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:45.948592 run osmo-msc_10.42.42.6(pid=2820): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2820)] 18:50:45.999955 run osmo-msc_10.42.42.6(pid=2820): stdout: | (launched: 2022-12-09_18:50:44.807368) 18:50:46.056352 run osmo-msc_10.42.42.6(pid=2820): stderr: | [0;m[38;5;43m20221209185045127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185045127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f939eda6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185045127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185045127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185045128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185045128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185045130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185045130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185045130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185045130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:46.106925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Terminating (SIGTERM) 18:50:46.148175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Terminating (SIGTERM) 18:50:46.191734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Terminating (SIGTERM) 18:50:46.234404 --- ParallelTerminationStrategy: PID 2813 died... 18:50:46.253702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Terminated: ok {rc=0} 18:50:46.300561 --- ParallelTerminationStrategy: PID 2816 died... 18:50:46.319338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Terminated: ok {rc=0} 18:50:46.365701 --- ParallelTerminationStrategy: PID 2819 died... 18:50:46.385955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Terminated: ok {rc=0} 18:50:46.472808 bus /sierra_9: Setting Powered False 18:50:47.569950 bus /sierra_9: Setting Powered False 18:50:48.684865 bus /sierra_8: Setting Powered False 18:50:49.781797 bus /sierra_8: Setting Powered False 18:50:50.895588 bus /sierra_3: Setting Powered False 18:50:51.992093 bus /sierra_3: Setting Powered False 18:50:53.109615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:oc2g --------------------------------------------------------------------- 18:50:54.368098 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:54.372464 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 18:50:54.392454 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 18:50:54.429858 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 18:50:54.515054 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 18:50:54.534926 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 18:50:54.572091 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 18:50:55.164171 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 18:50:55.217971 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.229131 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:50:55.265594 tst cs_paging_gprs_active.py: using LAC 23009 18:50:55.390282 tst cs_paging_gprs_active.py: using RAC 59 18:50:55.508313 tst cs_paging_gprs_active.py: using CellId 23009 18:50:55.634864 tst cs_paging_gprs_active.py: using BVCI 23010 18:50:55.754107 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.764824 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.775483 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.786501 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.797225 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.807931 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.818866 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.829733 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:50:55.840650 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:50:55.957638 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:50:56.076810 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:50:56.296554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:50:56.622873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2825): Launched 18:50:56.905174 run iperf3-srv_10.42.42.10(pid=2826): Launched 18:50:57.026941 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:50:57.246683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:50:57.572476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2827): Launched 18:50:57.854370 run iperf3-srv_10.42.42.10(pid=2828): Launched 18:50:57.975140 tst cs_paging_gprs_active.py:38: start network... 18:50:58.194810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:58.696774 run create_hlr_db(pid=2829): Launched 18:50:58.819714 bus /sierra_2: Setting Powered False 18:50:59.883715 run create_hlr_db(pid=2829): Terminated: ok {rc=0} 18:51:00.317080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2831): Launched 18:51:00.620855 run osmo-hlr_10.42.42.2(pid=2832): Launched 18:51:00.735330 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:01.337564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2834): Launched 18:51:01.660709 run osmo-stp_10.42.42.5(pid=2835): Launched 18:51:01.886251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:02.627454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2837): Launched 18:51:02.751794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:03.026765 run patchelf(pid=2838): Launched 18:51:03.207227 run osmo-stp_10.42.42.5(pid=2835): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2835)] 18:51:03.344704 run osmo-stp_10.42.42.5(pid=2835): stdout: | (launched: 2022-12-09_18:51:01.596438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:03.483496 run osmo-stp_10.42.42.5(pid=2835): stderr: | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185101853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185101855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185101855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185101856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:03.622764 run osmo-stp_10.42.42.5(pid=2835): stdout: | (launched: 2022-12-09_18:51:01.596438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:03.755778 run osmo-stp_10.42.42.5(pid=2835): stderr: | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185101852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185101853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185101855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185101855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185101856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:03.912903 run patchelf(pid=2838): Terminating (SIGINT) 18:51:04.095010 run patchelf(pid=2838): Terminated: ok {rc=0} 18:51:04.225778 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2835): Process ended prematurely: osmo-stp_10.42.42.5(pid=2835) [trial-2363↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2835)] [trial-2363↪gprs:oc2g↪cs_paging_gprs_active.py:38] 18:51:04.235686 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 18:51:04.264571 run osmo-hlr_10.42.42.2(pid=2832): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2832)] 18:51:04.314484 run osmo-hlr_10.42.42.2(pid=2832): stdout: | (launched: 2022-12-09_18:51:00.564564) 18:51:04.366377 run osmo-hlr_10.42.42.2(pid=2832): stderr: | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185100741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185100754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185100764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185100764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185100764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:04.418396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2825): Terminating (SIGTERM) 18:51:04.459986 run iperf3-srv_10.42.42.10(pid=2826): Terminating (SIGTERM) 18:51:04.501301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2827): Terminating (SIGTERM) 18:51:04.542763 run iperf3-srv_10.42.42.10(pid=2828): Terminating (SIGTERM) 18:51:04.583795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2831): Terminating (SIGTERM) 18:51:04.624935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2834): Terminating (SIGTERM) 18:51:04.665937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2837): Terminating (SIGTERM) 18:51:04.707198 --- ParallelTerminationStrategy: PID 2825 died... 18:51:04.726966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2825): Terminated: ok {rc=0} 18:51:04.773174 --- ParallelTerminationStrategy: PID 2826 died... 18:51:04.792376 run iperf3-srv_10.42.42.10(pid=2826): Terminated {rc=256} 18:51:04.837699 --- ParallelTerminationStrategy: PID 2827 died... 18:51:04.857085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2827): Terminated: ok {rc=0} 18:51:04.902763 --- ParallelTerminationStrategy: PID 2828 died... 18:51:04.922030 run iperf3-srv_10.42.42.10(pid=2828): Terminated {rc=256} 18:51:04.967403 --- ParallelTerminationStrategy: PID 2831 died... 18:51:04.986468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2831): Terminated: ok {rc=0} 18:51:05.032084 --- ParallelTerminationStrategy: PID 2834 died... 18:51:05.051226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2834): Terminated: ok {rc=0} 18:51:05.097074 --- ParallelTerminationStrategy: PID 2837 died... 18:51:05.116344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2837): Terminated: ok {rc=0} 18:51:05.203183 bus /gobi_0: Setting Powered False 18:51:06.299884 bus /gobi_0: Setting Powered False 18:51:07.413361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g iperf3.py ---------------------------------------------- 18:51:08.560380 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:08.571662 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:51:08.608845 tst iperf3.py: using LAC 23010 18:51:08.736543 tst iperf3.py: using RAC 60 18:51:08.862703 tst iperf3.py: using CellId 23010 18:51:08.990525 tst iperf3.py: using BVCI 23011 18:51:09.110021 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.120738 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.131400 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.142425 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.153530 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.164099 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.174964 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.185834 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:09.196692 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:09.315277 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:51:09.518399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:09.823723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Launched 18:51:10.086113 run iperf3-srv_10.42.42.10(pid=2841): Launched 18:51:10.198785 tst iperf3.py:8: start network... 18:51:10.400694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:10.868266 run create_hlr_db(pid=2842): Launched 18:51:10.992086 bus /gobi_6: Setting Powered False 18:51:12.051776 run create_hlr_db(pid=2842): Terminated: ok {rc=0} 18:51:12.493677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Launched 18:51:12.817155 run osmo-hlr_10.42.42.2(pid=2845): Launched 18:51:12.940255 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:13.496431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Launched 18:51:13.820838 run osmo-stp_10.42.42.5(pid=2848): Launched 18:51:13.943563 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:14.504613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2850): Launched 18:51:14.628048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:14.902201 run patchelf(pid=2851): Launched 18:51:15.082174 run osmo-stp_10.42.42.5(pid=2848): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] 18:51:15.218992 run osmo-stp_10.42.42.5(pid=2848): stdout: | (launched: 2022-12-09_18:51:13.761317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:15.357322 run osmo-stp_10.42.42.5(pid=2848): stderr: | [0;m[38;5;43m20221209185113953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185113954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185113954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185113954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:15.495592 run osmo-stp_10.42.42.5(pid=2848): stdout: | (launched: 2022-12-09_18:51:13.761317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:15.628708 run osmo-stp_10.42.42.5(pid=2848): stderr: | [0;m[38;5;43m20221209185113953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185113954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185113954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185113954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185113955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:15.786086 run patchelf(pid=2851): Terminating (SIGINT) 18:51:16.011393 run patchelf(pid=2851): Terminated: ok {rc=0} 18:51:16.138360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2848): Process ended prematurely: osmo-stp_10.42.42.5(pid=2848) [trial-2363↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] [trial-2363↪gprs:oc2g↪iperf3.py:8] 18:51:16.148394 tst iperf3.py:8: Test FAILED (7.6 sec) 18:51:16.176525 run osmo-hlr_10.42.42.2(pid=2845): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2845)] 18:51:16.225875 run osmo-hlr_10.42.42.2(pid=2845): stdout: | (launched: 2022-12-09_18:51:12.757915) 18:51:16.276460 run osmo-hlr_10.42.42.2(pid=2845): stderr: | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185112955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185112968 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185112976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185112976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185112976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:16.327094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminating (SIGTERM) 18:51:16.368825 run iperf3-srv_10.42.42.10(pid=2841): Terminating (SIGTERM) 18:51:16.413181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Terminating (SIGTERM) 18:51:16.454354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Terminating (SIGTERM) 18:51:16.497230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2850): Terminating (SIGTERM) 18:51:16.540318 --- ParallelTerminationStrategy: PID 2840 died... 18:51:16.560001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminated: ok {rc=0} 18:51:16.608102 --- ParallelTerminationStrategy: PID 2841 died... 18:51:16.627458 run iperf3-srv_10.42.42.10(pid=2841): Terminated {rc=256} 18:51:16.672738 --- ParallelTerminationStrategy: PID 2844 died... 18:51:16.692218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Terminated: ok {rc=0} 18:51:16.736421 --- ParallelTerminationStrategy: PID 2847 died... 18:51:16.757004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Terminated: ok {rc=0} 18:51:16.802390 --- ParallelTerminationStrategy: PID 2850 died... 18:51:16.821545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2850): Terminated: ok {rc=0} 18:51:16.907876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g iperf3m4.py ---------------------------------------------- 18:51:18.052705 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.063473 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:51:18.102671 tst iperf3m4.py: using LAC 23011 18:51:18.220290 tst iperf3m4.py: using RAC 61 18:51:18.337633 tst iperf3m4.py: using CellId 23011 18:51:18.456811 tst iperf3m4.py: using BVCI 23012 18:51:18.566308 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.576624 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.586847 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.596917 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.606954 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.617075 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.627216 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.637293 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:18.647480 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:18.761459 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:18.877245 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:18.995482 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:19.113449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:51:19.332682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:19.660529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2852): Launched 18:51:19.944018 run iperf3-srv_10.42.42.10(pid=2853): Launched 18:51:20.066087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:51:20.286221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:20.612730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Launched 18:51:20.894051 run iperf3-srv_10.42.42.10(pid=2855): Launched 18:51:21.014797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:51:21.234355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:21.560544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Launched 18:51:21.842557 run iperf3-srv_10.42.42.10(pid=2857): Launched 18:51:21.964490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:51:22.184438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:22.510532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Launched 18:51:22.791511 run iperf3-srv_10.42.42.10(pid=2859): Launched 18:51:22.912055 tst iperf3m4.py:8: start network... 18:51:23.131775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:23.633944 run create_hlr_db(pid=2860): Launched 18:51:23.758307 bus /gobi_6: Setting Powered False 18:51:24.822210 run create_hlr_db(pid=2860): Terminated: ok {rc=0} 18:51:25.273474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2862): Launched 18:51:25.598396 run osmo-hlr_10.42.42.2(pid=2863): Launched 18:51:25.721495 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:26.277626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2865): Launched 18:51:26.601581 run osmo-stp_10.42.42.5(pid=2866): Launched 18:51:26.724702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:27.285127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2868): Launched 18:51:27.408439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:27.682919 run patchelf(pid=2869): Launched 18:51:27.862747 run osmo-stp_10.42.42.5(pid=2866): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2866)] 18:51:27.999967 run osmo-stp_10.42.42.5(pid=2866): stdout: | (launched: 2022-12-09_18:51:26.542030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:28.139011 run osmo-stp_10.42.42.5(pid=2866): stderr: | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185126732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:28.277554 run osmo-stp_10.42.42.5(pid=2866): stdout: | (launched: 2022-12-09_18:51:26.542030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:28.410055 run osmo-stp_10.42.42.5(pid=2866): stderr: | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185126731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185126732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185126732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:28.567685 run patchelf(pid=2869): Terminating (SIGINT) 18:51:28.748897 run patchelf(pid=2869): Terminated: ok {rc=0} 18:51:28.879695 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2866): Process ended prematurely: osmo-stp_10.42.42.5(pid=2866) [trial-2363↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2866)] [trial-2363↪gprs:oc2g↪iperf3m4.py:8] 18:51:28.889866 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:51:28.918510 run osmo-hlr_10.42.42.2(pid=2863): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2863)] 18:51:28.968419 run osmo-hlr_10.42.42.2(pid=2863): stdout: | (launched: 2022-12-09_18:51:25.538625) 18:51:29.019988 run osmo-hlr_10.42.42.2(pid=2863): stderr: | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185125734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185125747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185125758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185125758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185125758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:29.071527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2852): Terminating (SIGTERM) 18:51:29.112884 run iperf3-srv_10.42.42.10(pid=2853): Terminating (SIGTERM) 18:51:29.154175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminating (SIGTERM) 18:51:29.195482 run iperf3-srv_10.42.42.10(pid=2855): Terminating (SIGTERM) 18:51:29.236565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Terminating (SIGTERM) 18:51:29.278083 run iperf3-srv_10.42.42.10(pid=2857): Terminating (SIGTERM) 18:51:29.319206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Terminating (SIGTERM) 18:51:29.360674 run iperf3-srv_10.42.42.10(pid=2859): Terminating (SIGTERM) 18:51:29.401889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2862): Terminating (SIGTERM) 18:51:29.443152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2865): Terminating (SIGTERM) 18:51:29.484289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2868): Terminating (SIGTERM) 18:51:29.525819 --- ParallelTerminationStrategy: PID 2852 died... 18:51:29.545472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2852): Terminated: ok {rc=0} 18:51:29.591535 --- ParallelTerminationStrategy: PID 2853 died... 18:51:29.610773 run iperf3-srv_10.42.42.10(pid=2853): Terminated {rc=256} 18:51:29.656397 --- ParallelTerminationStrategy: PID 2854 died... 18:51:29.675707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminated: ok {rc=0} 18:51:29.721351 --- ParallelTerminationStrategy: PID 2855 died... 18:51:29.740483 run iperf3-srv_10.42.42.10(pid=2855): Terminated {rc=256} 18:51:29.786069 --- ParallelTerminationStrategy: PID 2856 died... 18:51:29.805345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Terminated: ok {rc=0} 18:51:29.851127 --- ParallelTerminationStrategy: PID 2857 died... 18:51:29.870381 run iperf3-srv_10.42.42.10(pid=2857): Terminated {rc=256} 18:51:29.916425 --- ParallelTerminationStrategy: PID 2858 died... 18:51:29.935737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Terminated: ok {rc=0} 18:51:29.981573 --- ParallelTerminationStrategy: PID 2859 died... 18:51:30.000755 run iperf3-srv_10.42.42.10(pid=2859): Terminated {rc=256} 18:51:30.046864 --- ParallelTerminationStrategy: PID 2862 died... 18:51:30.066187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2862): Terminated: ok {rc=0} 18:51:30.112066 --- ParallelTerminationStrategy: PID 2865 died... 18:51:30.131388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2865): Terminated: ok {rc=0} 18:51:30.177376 --- ParallelTerminationStrategy: PID 2868 died... 18:51:30.196649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2868): Terminated: ok {rc=0} 18:51:30.283466 bus /gobi_4: Setting Powered False 18:51:31.378797 bus /gobi_4: Setting Powered False 18:51:32.496658 bus /gobi_1: Setting Powered False 18:51:33.595888 bus /gobi_1: Setting Powered False 18:51:34.709661 bus /gobi_0: Setting Powered False 18:51:35.805496 bus /gobi_0: Setting Powered False 18:51:36.920690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g ping.py ---------------------------------------------- 18:51:38.022103 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.033687 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:51:38.070253 tst ping.py: using LAC 23012 18:51:38.195840 tst ping.py: using RAC 62 18:51:38.320199 tst ping.py: using CellId 23012 18:51:38.445213 tst ping.py: using BVCI 23013 18:51:38.561105 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.571832 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.582512 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.593453 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.604191 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.614977 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.625909 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:38.636723 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:38.749598 tst ping.py:19: start network... 18:51:38.950678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:39.411401 run create_hlr_db(pid=2870): Launched 18:51:39.532846 bus /gobi_6: Setting Powered False 18:51:40.592590 run create_hlr_db(pid=2870): Terminated: ok {rc=0} 18:51:41.027329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Launched 18:51:41.329825 run osmo-hlr_10.42.42.2(pid=2873): Launched 18:51:41.442858 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:41.954314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Launched 18:51:42.252746 run osmo-stp_10.42.42.5(pid=2876): Launched 18:51:42.365617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:42.877544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Launched 18:51:42.990624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:43.241860 run patchelf(pid=2879): Launched 18:51:43.406930 run osmo-stp_10.42.42.5(pid=2876): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] 18:51:43.531939 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-09_18:51:42.197451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:43.658605 run osmo-stp_10.42.42.5(pid=2876): stderr: | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185142368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:43.785515 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-09_18:51:42.197451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:43.907236 run osmo-stp_10.42.42.5(pid=2876): stderr: | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185142367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185142368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185142368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:44.051773 run patchelf(pid=2879): Terminating (SIGINT) 18:51:44.217780 run patchelf(pid=2879): Terminated: ok {rc=0} 18:51:44.337176 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2363↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] [trial-2363↪gprs:oc2g↪ping.py:22] 18:51:44.346007 tst ping.py:22: Test FAILED (6.3 sec) 18:51:44.372544 run osmo-hlr_10.42.42.2(pid=2873): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2873)] 18:51:44.419616 run osmo-hlr_10.42.42.2(pid=2873): stdout: | (launched: 2022-12-09_18:51:41.274530) 18:51:44.468369 run osmo-hlr_10.42.42.2(pid=2873): stderr: | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185141451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185141464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185141475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185141475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185141475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:44.517365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminating (SIGTERM) 18:51:44.556732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminating (SIGTERM) 18:51:44.596312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Terminating (SIGTERM) 18:51:44.635932 --- ParallelTerminationStrategy: PID 2872 died... 18:51:44.654703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminated: ok {rc=0} 18:51:44.698436 --- ParallelTerminationStrategy: PID 2875 died... 18:51:44.716796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminated: ok {rc=0} 18:51:44.760676 --- ParallelTerminationStrategy: PID 2878 died... 18:51:44.779101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Terminated: ok {rc=0} 18:51:44.863608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 18:51:45.955651 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:45.968017 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:51:46.009798 tst ping_idle_ping.py: using LAC 23013 18:51:46.129374 tst ping_idle_ping.py: using RAC 63 18:51:46.258088 tst ping_idle_ping.py: using CellId 23013 18:51:46.386624 tst ping_idle_ping.py: using BVCI 23014 18:51:46.528474 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.541996 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.554225 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.566858 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.582550 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.595532 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.607335 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:51:46.621636 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:51:46.744353 tst ping_idle_ping.py:24: start network... 18:51:46.947544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:47.416534 run create_hlr_db(pid=2880): Launched 18:51:47.542912 bus /gobi_6: Setting Powered False 18:51:48.606160 run create_hlr_db(pid=2880): Terminated: ok {rc=0} 18:51:49.033118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2882): Launched 18:51:49.331617 run osmo-hlr_10.42.42.2(pid=2883): Launched 18:51:49.444666 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:49.962196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2885): Launched 18:51:50.260894 run osmo-stp_10.42.42.5(pid=2886): Launched 18:51:50.374179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:50.887618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2888): Launched 18:51:51.000408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:51.251564 run patchelf(pid=2889): Launched 18:51:51.416159 run osmo-stp_10.42.42.5(pid=2886): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2886)] 18:51:51.541692 run osmo-stp_10.42.42.5(pid=2886): stdout: | (launched: 2022-12-09_18:51:50.204918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:51.668859 run osmo-stp_10.42.42.5(pid=2886): stderr: | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185150376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:51.796025 run osmo-stp_10.42.42.5(pid=2886): stdout: | (launched: 2022-12-09_18:51:50.204918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:51.918243 run osmo-stp_10.42.42.5(pid=2886): stderr: | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185150375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185150376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185150376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:52.063325 run patchelf(pid=2889): Terminating (SIGINT) 18:51:52.230143 run patchelf(pid=2889): Terminated: ok {rc=0} 18:51:52.350071 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2886): Process ended prematurely: osmo-stp_10.42.42.5(pid=2886) [trial-2363↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2886)] [trial-2363↪gprs:oc2g↪ping_idle_ping.py:27] 18:51:52.358754 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:51:52.384829 run osmo-hlr_10.42.42.2(pid=2883): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2883)] 18:51:52.431686 run osmo-hlr_10.42.42.2(pid=2883): stdout: | (launched: 2022-12-09_18:51:49.276339) 18:51:52.480201 run osmo-hlr_10.42.42.2(pid=2883): stderr: | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185149453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185149464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185149473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185149473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185149474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:52.528708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2882): Terminating (SIGTERM) 18:51:52.567551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2885): Terminating (SIGTERM) 18:51:52.606431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2888): Terminating (SIGTERM) 18:51:52.645657 --- ParallelTerminationStrategy: PID 2882 died... 18:51:52.664593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2882): Terminated: ok {rc=0} 18:51:52.707725 --- ParallelTerminationStrategy: PID 2885 died... 18:51:52.726085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2885): Terminated: ok {rc=0} 18:51:52.769321 --- ParallelTerminationStrategy: PID 2888 died... 18:51:52.787664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2888): Terminated: ok {rc=0} 18:51:52.871796 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 18:51:54.156521 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:51:54.161851 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:51:54.182650 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:51:54.219691 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:51:54.306576 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:51:54.328684 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:51:54.367967 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:51:54.951471 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:51:54.999704 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.010140 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:51:55.045272 tst cs_paging_gprs_active.py: using LAC 23014 18:51:55.161463 tst cs_paging_gprs_active.py: using RAC 64 18:51:55.277423 tst cs_paging_gprs_active.py: using CellId 23014 18:51:55.394205 tst cs_paging_gprs_active.py: using BVCI 23015 18:51:55.502584 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.513091 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.523347 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.533579 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.543745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.553982 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.564274 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.574449 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:51:55.584708 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:51:55.702301 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:51:55.816119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:51:56.015240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:56.314107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2893): Launched 18:51:56.571815 run iperf3-srv_10.42.42.10(pid=2894): Launched 18:51:56.682255 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:51:56.880262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:57.177526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2895): Launched 18:51:57.435167 run iperf3-srv_10.42.42.10(pid=2896): Launched 18:51:57.545990 tst cs_paging_gprs_active.py:38: start network... 18:51:57.744491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:58.206829 run create_hlr_db(pid=2897): Launched 18:51:58.327393 bus /gobi_6: Setting Powered False 18:51:59.386809 run create_hlr_db(pid=2897): Terminated: ok {rc=0} 18:51:59.819760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Launched 18:52:00.137975 run osmo-hlr_10.42.42.2(pid=2900): Launched 18:52:00.258518 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:00.802656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Launched 18:52:01.169315 run osmo-stp_10.42.42.5(pid=2903): Launched 18:52:01.455748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:02.023414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2905): Launched 18:52:02.149284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:02.420545 run patchelf(pid=2906): Launched 18:52:02.596255 run osmo-stp_10.42.42.5(pid=2903): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] 18:52:02.730892 run osmo-stp_10.42.42.5(pid=2903): stdout: | (launched: 2022-12-09_18:52:01.103999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:02.866796 run osmo-stp_10.42.42.5(pid=2903): stderr: | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185201303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:03.002998 run osmo-stp_10.42.42.5(pid=2903): stdout: | (launched: 2022-12-09_18:52:01.103999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:03.134131 run osmo-stp_10.42.42.5(pid=2903): stderr: | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185201302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185201303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185201303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:03.288775 run patchelf(pid=2906): Terminating (SIGINT) 18:52:03.466196 run patchelf(pid=2906): Terminated: ok {rc=0} 18:52:03.594450 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2903): Process ended prematurely: osmo-stp_10.42.42.5(pid=2903) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] [trial-2363↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:52:03.604767 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:52:03.633697 run osmo-hlr_10.42.42.2(pid=2900): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2900)] 18:52:03.683443 run osmo-hlr_10.42.42.2(pid=2900): stdout: | (launched: 2022-12-09_18:52:00.079592) 18:52:03.734634 run osmo-hlr_10.42.42.2(pid=2900): stderr: | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185200277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185200314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185200323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185200323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185200324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:03.786232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2893): Terminating (SIGTERM) 18:52:03.827835 run iperf3-srv_10.42.42.10(pid=2894): Terminating (SIGTERM) 18:52:03.869462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2895): Terminating (SIGTERM) 18:52:03.911170 run iperf3-srv_10.42.42.10(pid=2896): Terminating (SIGTERM) 18:52:03.952681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Terminating (SIGTERM) 18:52:03.994392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Terminating (SIGTERM) 18:52:04.035893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2905): Terminating (SIGTERM) 18:52:04.077948 --- ParallelTerminationStrategy: PID 2893 died... 18:52:04.097821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2893): Terminated: ok {rc=0} 18:52:04.144073 --- ParallelTerminationStrategy: PID 2894 died... 18:52:04.163411 run iperf3-srv_10.42.42.10(pid=2894): Terminated {rc=256} 18:52:04.209331 --- ParallelTerminationStrategy: PID 2895 died... 18:52:04.228443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2895): Terminated: ok {rc=0} 18:52:04.274788 --- ParallelTerminationStrategy: PID 2896 died... 18:52:04.294047 run iperf3-srv_10.42.42.10(pid=2896): Terminated {rc=256} 18:52:04.339769 --- ParallelTerminationStrategy: PID 2899 died... 18:52:04.359074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Terminated: ok {rc=0} 18:52:04.404673 --- ParallelTerminationStrategy: PID 2902 died... 18:52:04.423897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Terminated: ok {rc=0} 18:52:04.469625 --- ParallelTerminationStrategy: PID 2905 died... 18:52:04.488830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2905): Terminated: ok {rc=0} 18:52:04.575970 bus /gobi_0: Setting Powered False 18:52:05.673352 bus /gobi_0: Setting Powered False 18:52:06.787133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:52:07.934071 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:07.945760 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:07.985568 tst iperf3.py: using LAC 23015 18:52:08.109608 tst iperf3.py: using RAC 65 18:52:08.234647 tst iperf3.py: using CellId 23015 18:52:08.356613 tst iperf3.py: using BVCI 23016 18:52:08.471604 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.482777 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.493876 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.504860 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.515825 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.526850 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.538020 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.548909 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:08.560137 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:08.675764 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:08.875435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:09.174796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2907): Launched 18:52:09.433078 run iperf3-srv_10.42.42.10(pid=2908): Launched 18:52:09.543651 tst iperf3.py:8: start network... 18:52:09.741741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:10.200437 run create_hlr_db(pid=2909): Launched 18:52:10.322131 bus /gobi_6: Setting Powered False 18:52:11.381522 run create_hlr_db(pid=2909): Terminated: ok {rc=0} 18:52:11.794643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2911): Launched 18:52:12.090064 run osmo-hlr_10.42.42.2(pid=2912): Launched 18:52:12.200584 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:12.707904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2914): Launched 18:52:13.004099 run osmo-stp_10.42.42.5(pid=2915): Launched 18:52:13.116685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:13.627068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2917): Launched 18:52:13.739682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:13.989963 run patchelf(pid=2918): Launched 18:52:14.154329 run osmo-stp_10.42.42.5(pid=2915): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2915)] 18:52:14.280533 run osmo-stp_10.42.42.5(pid=2915): stdout: | (launched: 2022-12-09_18:52:12.949331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:14.407641 run osmo-stp_10.42.42.5(pid=2915): stderr: | [0;m[38;5;43m20221209185213121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185213121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185213122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185213122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185213122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185213123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185213123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:14.535017 run osmo-stp_10.42.42.5(pid=2915): stdout: | (launched: 2022-12-09_18:52:12.949331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:14.656097 run osmo-stp_10.42.42.5(pid=2915): stderr: | [0;m[38;5;43m20221209185213121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185213121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185213122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185213122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185213122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185213123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185213123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:14.799750 run patchelf(pid=2918): Terminating (SIGINT) 18:52:14.965525 run patchelf(pid=2918): Terminated: ok {rc=0} 18:52:15.085458 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2915): Process ended prematurely: osmo-stp_10.42.42.5(pid=2915) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2915)] [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 18:52:15.094656 tst iperf3.py:8: Test FAILED (7.2 sec) 18:52:15.120899 run osmo-hlr_10.42.42.2(pid=2912): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2912)] 18:52:15.167596 run osmo-hlr_10.42.42.2(pid=2912): stdout: | (launched: 2022-12-09_18:52:12.035230) 18:52:15.215932 run osmo-hlr_10.42.42.2(pid=2912): stderr: | [0;m[1;31m20221209185212210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185212210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185212210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185212211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185212211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185212211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185212222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185212231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185212232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185212232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:15.264640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2907): Terminating (SIGTERM) 18:52:15.303463 run iperf3-srv_10.42.42.10(pid=2908): Terminating (SIGTERM) 18:52:15.342490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2911): Terminating (SIGTERM) 18:52:15.381508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2914): Terminating (SIGTERM) 18:52:15.420248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2917): Terminating (SIGTERM) 18:52:15.459400 --- ParallelTerminationStrategy: PID 2907 died... 18:52:15.477982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2907): Terminated: ok {rc=0} 18:52:15.521152 --- ParallelTerminationStrategy: PID 2908 died... 18:52:15.539324 run iperf3-srv_10.42.42.10(pid=2908): Terminated {rc=256} 18:52:15.582429 --- ParallelTerminationStrategy: PID 2911 died... 18:52:15.600755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2911): Terminated: ok {rc=0} 18:52:15.643849 --- ParallelTerminationStrategy: PID 2914 died... 18:52:15.662057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2914): Terminated: ok {rc=0} 18:52:15.705315 --- ParallelTerminationStrategy: PID 2917 died... 18:52:15.723562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2917): Terminated: ok {rc=0} 18:52:15.805524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:52:16.950472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:16.962131 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:17.000131 tst iperf3m4.py: using LAC 23016 18:52:17.139433 tst iperf3m4.py: using RAC 66 18:52:17.267772 tst iperf3m4.py: using CellId 23016 18:52:17.383867 tst iperf3m4.py: using BVCI 23017 18:52:17.492771 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.503369 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.513783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.524168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.534413 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.544520 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.554994 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.565238 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:17.575716 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:17.694660 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:17.812639 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:17.930630 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:18.048224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:18.263020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:18.582704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2919): Launched 18:52:18.857952 run iperf3-srv_10.42.42.10(pid=2920): Launched 18:52:18.976530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:52:19.191243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:19.510340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2921): Launched 18:52:19.787128 run iperf3-srv_10.42.42.10(pid=2922): Launched 18:52:19.905513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:52:20.119848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:20.439193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2923): Launched 18:52:20.714302 run iperf3-srv_10.42.42.10(pid=2924): Launched 18:52:20.832481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:52:21.046957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:21.366162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2925): Launched 18:52:21.642455 run iperf3-srv_10.42.42.10(pid=2926): Launched 18:52:21.761167 tst iperf3m4.py:8: start network... 18:52:21.975663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:22.468496 run create_hlr_db(pid=2927): Launched 18:52:22.588584 bus /gobi_6: Setting Powered False 18:52:23.651406 run create_hlr_db(pid=2927): Terminated: ok {rc=0} 18:52:24.094181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Launched 18:52:24.411246 run osmo-hlr_10.42.42.2(pid=2930): Launched 18:52:24.531914 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:25.079998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Launched 18:52:25.380908 run osmo-stp_10.42.42.5(pid=2933): Launched 18:52:25.493375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:26.006380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2935): Launched 18:52:26.120535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:26.373406 run patchelf(pid=2936): Launched 18:52:26.537874 run osmo-stp_10.42.42.5(pid=2933): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] 18:52:26.663571 run osmo-stp_10.42.42.5(pid=2933): stdout: | (launched: 2022-12-09_18:52:25.325901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:26.790398 run osmo-stp_10.42.42.5(pid=2933): stderr: | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185225493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:26.917853 run osmo-stp_10.42.42.5(pid=2933): stdout: | (launched: 2022-12-09_18:52:25.325901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:27.039219 run osmo-stp_10.42.42.5(pid=2933): stderr: | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185225492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185225493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185225493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:27.183391 run patchelf(pid=2936): Terminating (SIGINT) 18:52:27.349643 run patchelf(pid=2936): Terminated: ok {rc=0} 18:52:27.469696 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2933): Process ended prematurely: osmo-stp_10.42.42.5(pid=2933) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 18:52:27.479044 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:52:27.505556 run osmo-hlr_10.42.42.2(pid=2930): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2930)] 18:52:27.551718 run osmo-hlr_10.42.42.2(pid=2930): stdout: | (launched: 2022-12-09_18:52:24.353127) 18:52:27.599625 run osmo-hlr_10.42.42.2(pid=2930): stderr: | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185224546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185224559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185224569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185224569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185224569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:27.647878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2919): Terminating (SIGTERM) 18:52:27.686763 run iperf3-srv_10.42.42.10(pid=2920): Terminating (SIGTERM) 18:52:27.725357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2921): Terminating (SIGTERM) 18:52:27.764793 run iperf3-srv_10.42.42.10(pid=2922): Terminating (SIGTERM) 18:52:27.803653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2923): Terminating (SIGTERM) 18:52:27.842811 run iperf3-srv_10.42.42.10(pid=2924): Terminating (SIGTERM) 18:52:27.881814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2925): Terminating (SIGTERM) 18:52:27.920785 run iperf3-srv_10.42.42.10(pid=2926): Terminating (SIGTERM) 18:52:27.959723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Terminating (SIGTERM) 18:52:27.998378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Terminating (SIGTERM) 18:52:28.037296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2935): Terminating (SIGTERM) 18:52:28.076621 --- ParallelTerminationStrategy: PID 2919 died... 18:52:28.095415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2919): Terminated: ok {rc=0} 18:52:28.139121 --- ParallelTerminationStrategy: PID 2920 died... 18:52:28.157379 run iperf3-srv_10.42.42.10(pid=2920): Terminated {rc=256} 18:52:28.200617 --- ParallelTerminationStrategy: PID 2921 died... 18:52:28.218976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2921): Terminated: ok {rc=0} 18:52:28.262071 --- ParallelTerminationStrategy: PID 2922 died... 18:52:28.280398 run iperf3-srv_10.42.42.10(pid=2922): Terminated {rc=256} 18:52:28.323423 --- ParallelTerminationStrategy: PID 2923 died... 18:52:28.342206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2923): Terminated: ok {rc=0} 18:52:28.386001 --- ParallelTerminationStrategy: PID 2924 died... 18:52:28.404254 run iperf3-srv_10.42.42.10(pid=2924): Terminated {rc=256} 18:52:28.447354 --- ParallelTerminationStrategy: PID 2925 died... 18:52:28.465576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2925): Terminated: ok {rc=0} 18:52:28.508555 --- ParallelTerminationStrategy: PID 2926 died... 18:52:28.527036 run iperf3-srv_10.42.42.10(pid=2926): Terminated {rc=256} 18:52:28.570178 --- ParallelTerminationStrategy: PID 2929 died... 18:52:28.588543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Terminated: ok {rc=0} 18:52:28.631644 --- ParallelTerminationStrategy: PID 2932 died... 18:52:28.650070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Terminated: ok {rc=0} 18:52:28.693205 --- ParallelTerminationStrategy: PID 2935 died... 18:52:28.711517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2935): Terminated: ok {rc=0} 18:52:28.793691 bus /gobi_4: Setting Powered False 18:52:29.889465 bus /gobi_4: Setting Powered False 18:52:31.019041 bus /gobi_1: Setting Powered False 18:52:32.144350 bus /gobi_1: Setting Powered False 18:52:33.262287 bus /gobi_0: Setting Powered False 18:52:34.358575 bus /gobi_0: Setting Powered False 18:52:35.473577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 18:52:36.574823 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.586387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:36.624176 tst ping.py: using LAC 23017 18:52:36.747630 tst ping.py: using RAC 67 18:52:36.863102 tst ping.py: using CellId 23017 18:52:36.985881 tst ping.py: using BVCI 23018 18:52:37.099422 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.110559 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.121643 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.133118 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.144106 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.155181 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.166447 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:37.177581 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:37.297468 tst ping.py:19: start network... 18:52:37.508439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:37.990936 run create_hlr_db(pid=2937): Launched 18:52:38.109284 bus /gobi_6: Setting Powered False 18:52:39.169535 run create_hlr_db(pid=2937): Terminated: ok {rc=0} 18:52:39.587751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2939): Launched 18:52:39.879974 run osmo-hlr_10.42.42.2(pid=2940): Launched 18:52:39.990301 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:40.493920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2942): Launched 18:52:40.786149 run osmo-stp_10.42.42.5(pid=2943): Launched 18:52:40.896929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:41.401202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2945): Launched 18:52:41.511788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:41.758192 run patchelf(pid=2946): Launched 18:52:41.919821 run osmo-stp_10.42.42.5(pid=2943): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2943)] 18:52:42.043128 run osmo-stp_10.42.42.5(pid=2943): stdout: | (launched: 2022-12-09_18:52:40.731328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:42.168219 run osmo-stp_10.42.42.5(pid=2943): stderr: | [0;m[38;5;43m20221209185240898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185240899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185240899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185240899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:42.292837 run osmo-stp_10.42.42.5(pid=2943): stdout: | (launched: 2022-12-09_18:52:40.731328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:42.412283 run osmo-stp_10.42.42.5(pid=2943): stderr: | [0;m[38;5;43m20221209185240898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185240899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185240899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185240899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185240900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:42.554066 run patchelf(pid=2946): Terminating (SIGINT) 18:52:42.716891 run patchelf(pid=2946): Terminated: ok {rc=0} 18:52:42.834280 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2943): Process ended prematurely: osmo-stp_10.42.42.5(pid=2943) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2943)] [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 18:52:42.843056 tst ping.py:22: Test FAILED (6.3 sec) 18:52:42.868930 run osmo-hlr_10.42.42.2(pid=2940): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2940)] 18:52:42.915573 run osmo-hlr_10.42.42.2(pid=2940): stdout: | (launched: 2022-12-09_18:52:39.826106) 18:52:42.963766 run osmo-hlr_10.42.42.2(pid=2940): stderr: | [0;m[1;31m20221209185240001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185240002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185240002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185240002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185240002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185240002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185240013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185240021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185240021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185240021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:43.012364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2939): Terminating (SIGTERM) 18:52:43.051320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2942): Terminating (SIGTERM) 18:52:43.090541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2945): Terminating (SIGTERM) 18:52:43.129814 --- ParallelTerminationStrategy: PID 2939 died... 18:52:43.148567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2939): Terminated: ok {rc=0} 18:52:43.192096 --- ParallelTerminationStrategy: PID 2942 died... 18:52:43.210410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2942): Terminated: ok {rc=0} 18:52:43.254144 --- ParallelTerminationStrategy: PID 2945 died... 18:52:43.272407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2945): Terminated: ok {rc=0} 18:52:43.353953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:52:44.438626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:44.450634 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:44.489677 tst ping_idle_ping.py: using LAC 23018 18:52:44.612712 tst ping_idle_ping.py: using RAC 68 18:52:44.733765 tst ping_idle_ping.py: using CellId 23018 18:52:44.870179 tst ping_idle_ping.py: using BVCI 23019 18:52:44.985371 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:44.996346 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.007210 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.018362 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.029280 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.040147 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.051246 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.062722 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:45.178726 tst ping_idle_ping.py:24: start network... 18:52:45.389650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:45.897751 run create_hlr_db(pid=2947): Launched 18:52:46.070339 bus /gobi_6: Setting Powered False 18:52:47.143417 run create_hlr_db(pid=2947): Terminated: ok {rc=0} 18:52:47.575645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2949): Launched 18:52:47.870646 run osmo-hlr_10.42.42.2(pid=2950): Launched 18:52:47.982061 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:48.486498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2952): Launched 18:52:48.779762 run osmo-stp_10.42.42.5(pid=2953): Launched 18:52:48.891202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:49.398161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2955): Launched 18:52:49.510677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:49.759112 run patchelf(pid=2956): Launched 18:52:49.922410 run osmo-stp_10.42.42.5(pid=2953): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2953)] 18:52:50.046120 run osmo-stp_10.42.42.5(pid=2953): stdout: | (launched: 2022-12-09_18:52:48.725504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:50.171410 run osmo-stp_10.42.42.5(pid=2953): stderr: | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185248897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:50.296762 run osmo-stp_10.42.42.5(pid=2953): stdout: | (launched: 2022-12-09_18:52:48.725504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:50.417070 run osmo-stp_10.42.42.5(pid=2953): stderr: | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185248896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185248897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185248897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:50.559962 run patchelf(pid=2956): Terminating (SIGINT) 18:52:50.723347 run patchelf(pid=2956): Terminated: ok {rc=0} 18:52:50.841263 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2953): Process ended prematurely: osmo-stp_10.42.42.5(pid=2953) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2953)] [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 18:52:50.850022 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:52:50.876193 run osmo-hlr_10.42.42.2(pid=2950): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2950)] 18:52:50.923061 run osmo-hlr_10.42.42.2(pid=2950): stdout: | (launched: 2022-12-09_18:52:47.815788) 18:52:50.971396 run osmo-hlr_10.42.42.2(pid=2950): stderr: | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185247990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185248002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185248011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185248012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185248012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:51.021019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2949): Terminating (SIGTERM) 18:52:51.060379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2952): Terminating (SIGTERM) 18:52:51.099481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2955): Terminating (SIGTERM) 18:52:51.138622 --- ParallelTerminationStrategy: PID 2949 died... 18:52:51.157263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2949): Terminated: ok {rc=0} 18:52:51.200429 --- ParallelTerminationStrategy: PID 2952 died... 18:52:51.218698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2952): Terminated: ok {rc=0} 18:52:51.262003 --- ParallelTerminationStrategy: PID 2955 died... 18:52:51.280355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2955): Terminated: ok {rc=0} 18:52:51.361786 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:52:52.651157 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:52:52.656675 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:52:52.676608 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:52:52.714136 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:52:52.797065 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:52:52.817105 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:52:52.854150 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:52:53.449265 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:52:53.496744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:53.507276 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:52:53.560710 tst cs_paging_gprs_active.py: using LAC 23019 18:52:53.677636 tst cs_paging_gprs_active.py: using RAC 69 18:52:53.792412 tst cs_paging_gprs_active.py: using CellId 23019 18:52:53.907746 tst cs_paging_gprs_active.py: using BVCI 23020 18:52:54.015545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.026224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.036526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.046962 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.057238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.067544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.077975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.088156 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:52:54.098716 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:52:54.215533 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:52:54.330169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:52:54.530854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:54.831389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2960): Launched 18:52:55.091468 run iperf3-srv_10.42.42.10(pid=2961): Launched 18:52:55.202380 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:52:55.402158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:55.701664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2962): Launched 18:52:55.960431 run iperf3-srv_10.42.42.10(pid=2963): Launched 18:52:56.071331 tst cs_paging_gprs_active.py:38: start network... 18:52:56.270890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:56.732693 run create_hlr_db(pid=2964): Launched 18:52:56.853811 bus /gobi_6: Setting Powered False 18:52:57.913819 run create_hlr_db(pid=2964): Terminated: ok {rc=0} 18:52:58.350062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2966): Launched 18:52:58.669589 run osmo-hlr_10.42.42.2(pid=2967): Launched 18:52:58.791653 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:59.342346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2969): Launched 18:52:59.661712 run osmo-stp_10.42.42.5(pid=2970): Launched 18:52:59.782966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:00.333320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2972): Launched 18:53:00.455157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:00.726161 run patchelf(pid=2973): Launched 18:53:00.929175 run osmo-stp_10.42.42.5(pid=2970): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2970)] 18:53:01.061285 run osmo-stp_10.42.42.5(pid=2970): stdout: | (launched: 2022-12-09_18:52:59.603067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:01.195566 run osmo-stp_10.42.42.5(pid=2970): stderr: | [0;m[38;5;43m20221209185259793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185259793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185259794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185259794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185259794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185259795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185259795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:01.328376 run osmo-stp_10.42.42.5(pid=2970): stdout: | (launched: 2022-12-09_18:52:59.603067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:01.456921 run osmo-stp_10.42.42.5(pid=2970): stderr: | [0;m[38;5;43m20221209185259793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185259793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185259794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185259794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185259794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185259795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185259795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:01.608675 run patchelf(pid=2973): Terminating (SIGINT) 18:53:01.783150 run patchelf(pid=2973): Terminated: ok {rc=0} 18:53:01.916807 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2970): Process ended prematurely: osmo-stp_10.42.42.5(pid=2970) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2970)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:53:01.927195 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:53:01.956753 run osmo-hlr_10.42.42.2(pid=2967): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2967)] 18:53:02.015427 run osmo-hlr_10.42.42.2(pid=2967): stdout: | (launched: 2022-12-09_18:52:58.610914) 18:53:02.065566 run osmo-hlr_10.42.42.2(pid=2967): stderr: | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185258808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185258820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185258829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185258829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185258829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:02.116086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2960): Terminating (SIGTERM) 18:53:02.155671 run iperf3-srv_10.42.42.10(pid=2961): Terminating (SIGTERM) 18:53:02.201362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2962): Terminating (SIGTERM) 18:53:02.245048 run iperf3-srv_10.42.42.10(pid=2963): Terminating (SIGTERM) 18:53:02.284063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2966): Terminating (SIGTERM) 18:53:02.330930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2969): Terminating (SIGTERM) 18:53:02.383494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2972): Terminating (SIGTERM) 18:53:02.432227 --- ParallelTerminationStrategy: PID 2960 died... 18:53:02.452036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2960): Terminated: ok {rc=0} 18:53:02.501697 --- ParallelTerminationStrategy: PID 2961 died... 18:53:02.524265 run iperf3-srv_10.42.42.10(pid=2961): Terminated {rc=256} 18:53:02.569739 --- ParallelTerminationStrategy: PID 2962 died... 18:53:02.590271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2962): Terminated: ok {rc=0} 18:53:02.638370 --- ParallelTerminationStrategy: PID 2963 died... 18:53:02.657934 run iperf3-srv_10.42.42.10(pid=2963): Terminated {rc=256} 18:53:02.705775 --- ParallelTerminationStrategy: PID 2966 died... 18:53:02.725532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2966): Terminated: ok {rc=0} 18:53:02.773313 --- ParallelTerminationStrategy: PID 2969 died... 18:53:02.792825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2969): Terminated: ok {rc=0} 18:53:02.851583 --- ParallelTerminationStrategy: PID 2972 died... 18:53:02.877436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2972): Terminated: ok {rc=0} 18:53:02.966307 bus /gobi_0: Setting Powered False 18:53:04.063439 bus /gobi_0: Setting Powered False 18:53:05.180116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:53:06.334225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.346910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:06.410244 tst iperf3.py: using LAC 23020 18:53:06.541436 tst iperf3.py: using RAC 70 18:53:06.672863 tst iperf3.py: using CellId 23020 18:53:06.799897 tst iperf3.py: using BVCI 23021 18:53:06.918828 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.930798 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.942616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.955479 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.969242 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.982891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:06.994888 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:07.007688 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:07.022003 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:07.145876 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:07.367897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:07.703023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Launched 18:53:08.003260 run iperf3-srv_10.42.42.10(pid=3246): Launched 18:53:08.140591 tst iperf3.py:8: start network... 18:53:08.364455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:08.882829 run create_hlr_db(pid=3247): Launched 18:53:09.047942 bus /gobi_6: Setting Powered False 18:53:10.113176 run create_hlr_db(pid=3247): Terminated: ok {rc=0} 18:53:10.582645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3249): Launched 18:53:10.930075 run osmo-hlr_10.42.42.2(pid=3250): Launched 18:53:11.179708 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:11.865678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Launched 18:53:12.212869 run osmo-stp_10.42.42.5(pid=3253): Launched 18:53:12.469514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:13.115728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3255): Launched 18:53:13.254743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:13.544512 run patchelf(pid=3256): Launched 18:53:13.742085 run osmo-stp_10.42.42.5(pid=3253): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] 18:53:13.884307 run osmo-stp_10.42.42.5(pid=3253): stdout: | (launched: 2022-12-09_18:53:12.146735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:14.028193 run osmo-stp_10.42.42.5(pid=3253): stderr: | [0;m[38;5;43m20221209185312449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185312449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185312450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185312450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:14.172201 run osmo-stp_10.42.42.5(pid=3253): stdout: | (launched: 2022-12-09_18:53:12.146735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:14.311024 run osmo-stp_10.42.42.5(pid=3253): stderr: | [0;m[38;5;43m20221209185312449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185312449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185312450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185312450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185312451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:14.474782 run patchelf(pid=3256): Terminating (SIGINT) 18:53:14.661771 run patchelf(pid=3256): Terminated: ok {rc=0} 18:53:14.798278 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3253): Process ended prematurely: osmo-stp_10.42.42.5(pid=3253) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 18:53:14.809624 tst iperf3.py:8: Test FAILED (8.5 sec) 18:53:14.841509 run osmo-hlr_10.42.42.2(pid=3250): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3250)] 18:53:14.893649 run osmo-hlr_10.42.42.2(pid=3250): stdout: | (launched: 2022-12-09_18:53:10.864714) 18:53:14.947256 run osmo-hlr_10.42.42.2(pid=3250): stderr: | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185311172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185311191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185311204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185311204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185311205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:15.003253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Terminating (SIGTERM) 18:53:15.047460 run iperf3-srv_10.42.42.10(pid=3246): Terminating (SIGTERM) 18:53:15.094498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3249): Terminating (SIGTERM) 18:53:15.139036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Terminating (SIGTERM) 18:53:15.185333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3255): Terminating (SIGTERM) 18:53:15.232097 --- ParallelTerminationStrategy: PID 3245 died... 18:53:15.252882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Terminated: ok {rc=0} 18:53:15.303638 --- ParallelTerminationStrategy: PID 3246 died... 18:53:15.324261 run iperf3-srv_10.42.42.10(pid=3246): Terminated {rc=256} 18:53:15.373350 --- ParallelTerminationStrategy: PID 3249 died... 18:53:15.394756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3249): Terminated: ok {rc=0} 18:53:15.443741 --- ParallelTerminationStrategy: PID 3252 died... 18:53:15.464120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Terminated: ok {rc=0} 18:53:15.513526 --- ParallelTerminationStrategy: PID 3255 died... 18:53:15.534128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3255): Terminated: ok {rc=0} 18:53:15.626887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:53:16.828823 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:16.844750 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:16.919829 tst iperf3m4.py: using LAC 23021 18:53:17.057463 tst iperf3m4.py: using RAC 71 18:53:17.239256 tst iperf3m4.py: using CellId 23021 18:53:17.379192 tst iperf3m4.py: using BVCI 23022 18:53:17.502247 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.515451 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.528925 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.542092 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.554225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.567652 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.581980 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.596026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:17.609444 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:17.733542 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:17.862001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:17.984073 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:18.107318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:18.334388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:18.670433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3257): Launched 18:53:18.970682 run iperf3-srv_10.42.42.10(pid=3258): Launched 18:53:19.110133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:53:19.337056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:19.676706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Launched 18:53:19.979128 run iperf3-srv_10.42.42.10(pid=3260): Launched 18:53:20.118871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:53:20.345766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:20.685740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Launched 18:53:20.988461 run iperf3-srv_10.42.42.10(pid=3262): Launched 18:53:21.126972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:53:21.353102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:21.692497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Launched 18:53:21.995893 run iperf3-srv_10.42.42.10(pid=3264): Launched 18:53:22.134613 tst iperf3m4.py:8: start network... 18:53:22.361008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:22.878801 run create_hlr_db(pid=3265): Launched 18:53:23.038966 bus /gobi_6: Setting Powered False 18:53:24.103979 run create_hlr_db(pid=3265): Terminated: ok {rc=0} 18:53:24.538273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3267): Launched 18:53:24.844257 run osmo-hlr_10.42.42.2(pid=3268): Launched 18:53:24.958804 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:25.481708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3270): Launched 18:53:25.784900 run osmo-stp_10.42.42.5(pid=3271): Launched 18:53:25.899154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:26.421744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3273): Launched 18:53:26.536850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:26.794371 run patchelf(pid=3274): Launched 18:53:26.964430 run osmo-stp_10.42.42.5(pid=3271): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3271)] 18:53:27.092659 run osmo-stp_10.42.42.5(pid=3271): stdout: | (launched: 2022-12-09_18:53:25.728530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:27.222692 run osmo-stp_10.42.42.5(pid=3271): stderr: | [0;m[38;5;43m20221209185325901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185325902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185325902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185325902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:27.352510 run osmo-stp_10.42.42.5(pid=3271): stdout: | (launched: 2022-12-09_18:53:25.728530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:27.476558 run osmo-stp_10.42.42.5(pid=3271): stderr: | [0;m[38;5;43m20221209185325901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185325902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185325902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185325902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185325903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:27.623504 run patchelf(pid=3274): Terminating (SIGINT) 18:53:27.792696 run patchelf(pid=3274): Terminated: ok {rc=0} 18:53:27.915020 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3271): Process ended prematurely: osmo-stp_10.42.42.5(pid=3271) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3271)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:53:27.924299 tst iperf3m4.py:8: Test FAILED (11.2 sec) 18:53:27.950916 run osmo-hlr_10.42.42.2(pid=3268): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3268)] 18:53:27.997301 run osmo-hlr_10.42.42.2(pid=3268): stdout: | (launched: 2022-12-09_18:53:24.786961) 18:53:28.045476 run osmo-hlr_10.42.42.2(pid=3268): stderr: | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185324965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185324978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185324988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185324988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185324988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:28.093972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3257): Terminating (SIGTERM) 18:53:28.132516 run iperf3-srv_10.42.42.10(pid=3258): Terminating (SIGTERM) 18:53:28.171112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Terminating (SIGTERM) 18:53:28.209550 run iperf3-srv_10.42.42.10(pid=3260): Terminating (SIGTERM) 18:53:28.247779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Terminating (SIGTERM) 18:53:28.286338 run iperf3-srv_10.42.42.10(pid=3262): Terminating (SIGTERM) 18:53:28.324647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Terminating (SIGTERM) 18:53:28.363101 run iperf3-srv_10.42.42.10(pid=3264): Terminating (SIGTERM) 18:53:28.401471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3267): Terminating (SIGTERM) 18:53:28.440519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3270): Terminating (SIGTERM) 18:53:28.479056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3273): Terminating (SIGTERM) 18:53:28.517732 --- ParallelTerminationStrategy: PID 3257 died... 18:53:28.536214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3257): Terminated: ok {rc=0} 18:53:28.579175 --- ParallelTerminationStrategy: PID 3258 died... 18:53:28.597154 run iperf3-srv_10.42.42.10(pid=3258): Terminated {rc=256} 18:53:28.639521 --- ParallelTerminationStrategy: PID 3259 died... 18:53:28.657633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Terminated: ok {rc=0} 18:53:28.700405 --- ParallelTerminationStrategy: PID 3260 died... 18:53:28.718554 run iperf3-srv_10.42.42.10(pid=3260): Terminated {rc=256} 18:53:28.761114 --- ParallelTerminationStrategy: PID 3261 died... 18:53:28.779090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Terminated: ok {rc=0} 18:53:28.822108 --- ParallelTerminationStrategy: PID 3262 died... 18:53:28.840125 run iperf3-srv_10.42.42.10(pid=3262): Terminated {rc=256} 18:53:28.882658 --- ParallelTerminationStrategy: PID 3263 died... 18:53:28.900590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Terminated: ok {rc=0} 18:53:28.943315 --- ParallelTerminationStrategy: PID 3264 died... 18:53:28.961421 run iperf3-srv_10.42.42.10(pid=3264): Terminated {rc=256} 18:53:29.003930 --- ParallelTerminationStrategy: PID 3267 died... 18:53:29.021988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3267): Terminated: ok {rc=0} 18:53:29.064613 --- ParallelTerminationStrategy: PID 3270 died... 18:53:29.082862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3270): Terminated: ok {rc=0} 18:53:29.125643 --- ParallelTerminationStrategy: PID 3273 died... 18:53:29.143759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3273): Terminated: ok {rc=0} 18:53:29.227533 bus /gobi_4: Setting Powered False 18:53:30.327948 bus /gobi_4: Setting Powered False 18:53:31.453785 bus /gobi_1: Setting Powered False 18:53:32.559972 bus /gobi_1: Setting Powered False 18:53:33.670321 bus /gobi_0: Setting Powered False 18:53:34.767037 bus /gobi_0: Setting Powered False 18:53:35.884631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:53:36.987452 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.000413 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:37.058517 tst ping.py: using LAC 23022 18:53:37.178412 tst ping.py: using RAC 72 18:53:37.309860 tst ping.py: using CellId 23022 18:53:37.425240 tst ping.py: using BVCI 23023 18:53:37.532307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.543015 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.553741 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.564845 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.575885 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.586982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.598043 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.608882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:37.727262 tst ping.py:19: start network... 18:53:37.940587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:38.427526 run create_hlr_db(pid=3275): Launched 18:53:38.547663 bus /gobi_6: Setting Powered False 18:53:39.609516 run create_hlr_db(pid=3275): Terminated: ok {rc=0} 18:53:40.029352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3277): Launched 18:53:40.344675 run osmo-hlr_10.42.42.2(pid=3278): Launched 18:53:40.464503 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:41.007937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3280): Launched 18:53:41.321570 run osmo-stp_10.42.42.5(pid=3281): Launched 18:53:41.443313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:41.987965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3283): Launched 18:53:42.108490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:42.373620 run patchelf(pid=3284): Launched 18:53:42.549519 run osmo-stp_10.42.42.5(pid=3281): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3281)] 18:53:42.682906 run osmo-stp_10.42.42.5(pid=3281): stdout: | (launched: 2022-12-09_18:53:41.264873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:42.817921 run osmo-stp_10.42.42.5(pid=3281): stderr: | [0;m[38;5;43m20221209185341452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185341452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185341453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185341453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:42.953567 run osmo-stp_10.42.42.5(pid=3281): stdout: | (launched: 2022-12-09_18:53:41.264873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:43.082838 run osmo-stp_10.42.42.5(pid=3281): stderr: | [0;m[38;5;43m20221209185341452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185341452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185341453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185341453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185341454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:43.236081 run patchelf(pid=3284): Terminating (SIGINT) 18:53:43.411942 run patchelf(pid=3284): Terminated: ok {rc=0} 18:53:43.538926 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3281): Process ended prematurely: osmo-stp_10.42.42.5(pid=3281) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3281)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 18:53:43.548360 tst ping.py:22: Test FAILED (6.6 sec) 18:53:43.576367 run osmo-hlr_10.42.42.2(pid=3278): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3278)] 18:53:43.625496 run osmo-hlr_10.42.42.2(pid=3278): stdout: | (launched: 2022-12-09_18:53:40.287491) 18:53:43.676317 run osmo-hlr_10.42.42.2(pid=3278): stderr: | [0;m[1;31m20221209185340481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185340481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185340481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185340482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185340482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185340482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185340494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185340502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185340502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185340503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:43.727384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3277): Terminating (SIGTERM) 18:53:43.768564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3280): Terminating (SIGTERM) 18:53:43.809918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3283): Terminating (SIGTERM) 18:53:43.851232 --- ParallelTerminationStrategy: PID 3277 died... 18:53:43.870799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3277): Terminated: ok {rc=0} 18:53:43.916713 --- ParallelTerminationStrategy: PID 3280 died... 18:53:43.935762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3280): Terminated: ok {rc=0} 18:53:43.981681 --- ParallelTerminationStrategy: PID 3283 died... 18:53:44.000669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3283): Terminated: ok {rc=0} 18:53:44.086842 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:53:45.172578 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.183988 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:45.244917 tst ping_idle_ping.py: using LAC 23023 18:53:45.370466 tst ping_idle_ping.py: using RAC 73 18:53:45.497882 tst ping_idle_ping.py: using CellId 23023 18:53:45.620006 tst ping_idle_ping.py: using BVCI 23024 18:53:45.734582 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.745889 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.756868 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.768275 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.779458 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.790638 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.802005 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:45.813165 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:45.948400 tst ping_idle_ping.py:24: start network... 18:53:46.151827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:46.680009 run create_hlr_db(pid=3286): Launched 18:53:46.837085 bus /gobi_6: Setting Powered False 18:53:47.897182 run create_hlr_db(pid=3286): Terminated: ok {rc=0} 18:53:48.310885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Launched 18:53:48.605119 run osmo-hlr_10.42.42.2(pid=3289): Launched 18:53:48.717071 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:49.224900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Launched 18:53:49.520177 run osmo-stp_10.42.42.5(pid=3292): Launched 18:53:49.632641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:50.142883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3294): Launched 18:53:50.254890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:50.503254 run patchelf(pid=3295): Launched 18:53:50.666922 run osmo-stp_10.42.42.5(pid=3292): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] 18:53:50.791696 run osmo-stp_10.42.42.5(pid=3292): stdout: | (launched: 2022-12-09_18:53:49.465898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:50.918293 run osmo-stp_10.42.42.5(pid=3292): stderr: | [0;m[38;5;43m20221209185349630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185349631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185349631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185349631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:51.044851 run osmo-stp_10.42.42.5(pid=3292): stdout: | (launched: 2022-12-09_18:53:49.465898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:51.165880 run osmo-stp_10.42.42.5(pid=3292): stderr: | [0;m[38;5;43m20221209185349630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185349631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185349631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185349631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185349632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:51.310589 run patchelf(pid=3295): Terminating (SIGINT) 18:53:51.475810 run patchelf(pid=3295): Terminated: ok {rc=0} 18:53:51.595243 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3292): Process ended prematurely: osmo-stp_10.42.42.5(pid=3292) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:53:51.604011 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:53:51.629992 run osmo-hlr_10.42.42.2(pid=3289): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3289)] 18:53:51.676301 run osmo-hlr_10.42.42.2(pid=3289): stdout: | (launched: 2022-12-09_18:53:48.551069) 18:53:51.724515 run osmo-hlr_10.42.42.2(pid=3289): stderr: | [0;m[1;31m20221209185348722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185348722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185348722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185348722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185348722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185348723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185348735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185348744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185348744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185348744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:51.773351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Terminating (SIGTERM) 18:53:51.812451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Terminating (SIGTERM) 18:53:51.851383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3294): Terminating (SIGTERM) 18:53:51.890627 --- ParallelTerminationStrategy: PID 3288 died... 18:53:51.909161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Terminated: ok {rc=0} 18:53:51.952329 --- ParallelTerminationStrategy: PID 3291 died... 18:53:51.970453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Terminated: ok {rc=0} 18:53:52.013276 --- ParallelTerminationStrategy: PID 3294 died... 18:53:52.031400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3294): Terminated: ok {rc=0} 18:53:52.112464 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:53:53.402840 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:53:53.409152 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:53:53.430276 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:53:53.468479 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:53:53.556365 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:53:53.577233 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:53:53.616106 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:53:54.215120 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:53:54.266636 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.277701 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:53:54.333505 tst cs_paging_gprs_active.py: using LAC 23024 18:53:54.459331 tst cs_paging_gprs_active.py: using RAC 74 18:53:54.575708 tst cs_paging_gprs_active.py: using CellId 23024 18:53:54.691793 tst cs_paging_gprs_active.py: using BVCI 23025 18:53:54.808846 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.820032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.830926 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.842183 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.853216 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.864347 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.875627 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.886765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:53:54.898044 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:53:55.012537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:53:55.129169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:53:55.330271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:55.629876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3300): Launched 18:53:55.889165 run iperf3-srv_10.42.42.10(pid=3301): Launched 18:53:56.000394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:53:56.200296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:56.500379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Launched 18:53:56.759726 run iperf3-srv_10.42.42.10(pid=3303): Launched 18:53:56.870974 tst cs_paging_gprs_active.py:38: start network... 18:53:57.071460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:57.533942 run create_hlr_db(pid=3304): Launched 18:53:57.656600 bus /gobi_6: Setting Powered False 18:53:58.717095 run create_hlr_db(pid=3304): Terminated: ok {rc=0} 18:53:59.154601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3306): Launched 18:53:59.474391 run osmo-hlr_10.42.42.2(pid=3307): Launched 18:53:59.597386 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:00.143472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3309): Launched 18:54:00.462996 run osmo-stp_10.42.42.5(pid=3310): Launched 18:54:00.585380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:01.143614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3312): Launched 18:54:01.299745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:01.567083 run patchelf(pid=3313): Launched 18:54:01.751569 run osmo-stp_10.42.42.5(pid=3310): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3310)] 18:54:01.883492 run osmo-stp_10.42.42.5(pid=3310): stdout: | (launched: 2022-12-09_18:54:00.405253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:02.016221 run osmo-stp_10.42.42.5(pid=3310): stderr: | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185400592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:02.148357 run osmo-stp_10.42.42.5(pid=3310): stdout: | (launched: 2022-12-09_18:54:00.405253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:02.273229 run osmo-stp_10.42.42.5(pid=3310): stderr: | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185400592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185400592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185400593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:02.419165 run patchelf(pid=3313): Terminating (SIGINT) 18:54:02.587240 run patchelf(pid=3313): Terminated: ok {rc=0} 18:54:02.708534 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3310): Process ended prematurely: osmo-stp_10.42.42.5(pid=3310) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3310)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:54:02.717932 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:54:02.744164 run osmo-hlr_10.42.42.2(pid=3307): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3307)] 18:54:02.790964 run osmo-hlr_10.42.42.2(pid=3307): stdout: | (launched: 2022-12-09_18:53:59.416507) 18:54:02.839309 run osmo-hlr_10.42.42.2(pid=3307): stderr: | [0;m[1;31m20221209185359610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185359611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185359611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185359611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185359611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185359611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185359623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185359631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185359631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185359631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:02.887774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3300): Terminating (SIGTERM) 18:54:02.926500 run iperf3-srv_10.42.42.10(pid=3301): Terminating (SIGTERM) 18:54:02.965206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Terminating (SIGTERM) 18:54:03.003846 run iperf3-srv_10.42.42.10(pid=3303): Terminating (SIGTERM) 18:54:03.042402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3306): Terminating (SIGTERM) 18:54:03.081301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3309): Terminating (SIGTERM) 18:54:03.120432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3312): Terminating (SIGTERM) 18:54:03.159745 --- ParallelTerminationStrategy: PID 3300 died... 18:54:03.178229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3300): Terminated: ok {rc=0} 18:54:03.221148 --- ParallelTerminationStrategy: PID 3301 died... 18:54:03.239075 run iperf3-srv_10.42.42.10(pid=3301): Terminated {rc=256} 18:54:03.281630 --- ParallelTerminationStrategy: PID 3302 died... 18:54:03.299547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Terminated: ok {rc=0} 18:54:03.342346 --- ParallelTerminationStrategy: PID 3303 died... 18:54:03.360328 run iperf3-srv_10.42.42.10(pid=3303): Terminated {rc=256} 18:54:03.402999 --- ParallelTerminationStrategy: PID 3306 died... 18:54:03.421127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3306): Terminated: ok {rc=0} 18:54:03.463602 --- ParallelTerminationStrategy: PID 3309 died... 18:54:03.481604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3309): Terminated: ok {rc=0} 18:54:03.524943 --- ParallelTerminationStrategy: PID 3312 died... 18:54:03.543050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3312): Terminated: ok {rc=0} 18:54:03.626900 bus /gobi_0: Setting Powered False 18:54:04.725070 bus /gobi_0: Setting Powered False 18:54:05.838342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:54:06.982361 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:06.993805 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:54:07.051743 tst iperf3.py: using LAC 23025 18:54:07.171180 tst iperf3.py: using RAC 75 18:54:07.289369 tst iperf3.py: using CellId 23025 18:54:07.405372 tst iperf3.py: using BVCI 23026 18:54:07.513110 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.523738 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.534168 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.544537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.554953 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.565315 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.575782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.586137 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:07.596617 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:07.713646 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:07.931372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:08.253114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Launched 18:54:08.530316 run iperf3-srv_10.42.42.10(pid=3315): Launched 18:54:08.649996 tst iperf3.py:8: start network... 18:54:08.867203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:09.363743 run create_hlr_db(pid=3316): Launched 18:54:09.484665 bus /gobi_6: Setting Powered False 18:54:10.547800 run create_hlr_db(pid=3316): Terminated: ok {rc=0} 18:54:10.992397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3318): Launched 18:54:11.312631 run osmo-hlr_10.42.42.2(pid=3319): Launched 18:54:11.434531 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:11.988333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3321): Launched 18:54:12.307142 run osmo-stp_10.42.42.5(pid=3322): Launched 18:54:12.428282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:12.977136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3324): Launched 18:54:13.098547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:13.369101 run patchelf(pid=3325): Launched 18:54:13.545260 run osmo-stp_10.42.42.5(pid=3322): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3322)] 18:54:13.680486 run osmo-stp_10.42.42.5(pid=3322): stdout: | (launched: 2022-12-09_18:54:12.249494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:13.817281 run osmo-stp_10.42.42.5(pid=3322): stderr: | [0;m[38;5;43m20221209185412438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185412439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185412439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185412439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:13.954411 run osmo-stp_10.42.42.5(pid=3322): stdout: | (launched: 2022-12-09_18:54:12.249494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:14.085222 run osmo-stp_10.42.42.5(pid=3322): stderr: | [0;m[38;5;43m20221209185412438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185412439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185412439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185412439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185412440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:14.241134 run patchelf(pid=3325): Terminating (SIGINT) 18:54:14.420245 run patchelf(pid=3325): Terminated: ok {rc=0} 18:54:14.549989 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3322): Process ended prematurely: osmo-stp_10.42.42.5(pid=3322) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3322)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 18:54:14.560079 tst iperf3.py:8: Test FAILED (7.6 sec) 18:54:14.588510 run osmo-hlr_10.42.42.2(pid=3319): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3319)] 18:54:14.637646 run osmo-hlr_10.42.42.2(pid=3319): stdout: | (launched: 2022-12-09_18:54:11.254693) 18:54:14.688515 run osmo-hlr_10.42.42.2(pid=3319): stderr: | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185411449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185411461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185411470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185411470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185411470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:14.739959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Terminating (SIGTERM) 18:54:14.781088 run iperf3-srv_10.42.42.10(pid=3315): Terminating (SIGTERM) 18:54:14.822209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3318): Terminating (SIGTERM) 18:54:14.863304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3321): Terminating (SIGTERM) 18:54:14.904480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3324): Terminating (SIGTERM) 18:54:14.945890 --- ParallelTerminationStrategy: PID 3314 died... 18:54:14.965330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Terminated: ok {rc=0} 18:54:15.010846 --- ParallelTerminationStrategy: PID 3315 died... 18:54:15.029998 run iperf3-srv_10.42.42.10(pid=3315): Terminated {rc=256} 18:54:15.075320 --- ParallelTerminationStrategy: PID 3318 died... 18:54:15.094677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3318): Terminated: ok {rc=0} 18:54:15.140427 --- ParallelTerminationStrategy: PID 3321 died... 18:54:15.159610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3321): Terminated: ok {rc=0} 18:54:15.205221 --- ParallelTerminationStrategy: PID 3324 died... 18:54:15.224248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3324): Terminated: ok {rc=0} 18:54:15.309412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:54:16.490186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:16.503138 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:54:16.565965 tst iperf3m4.py: using LAC 23026 18:54:16.685857 tst iperf3m4.py: using RAC 76 18:54:16.806055 tst iperf3m4.py: using CellId 23026 18:54:16.969265 tst iperf3m4.py: using BVCI 23027 18:54:17.098251 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.109950 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.121516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.133268 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.145054 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.156900 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.168899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.180414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:17.193684 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:17.311985 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:17.430588 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:17.549590 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:17.665863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:17.869480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:18.170965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Launched 18:54:18.431280 run iperf3-srv_10.42.42.10(pid=3327): Launched 18:54:18.542966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:54:18.744793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:19.045650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Launched 18:54:19.306614 run iperf3-srv_10.42.42.10(pid=3329): Launched 18:54:19.418753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:54:19.619417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:19.919405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Launched 18:54:20.178369 run iperf3-srv_10.42.42.10(pid=3331): Launched 18:54:20.289788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:54:20.490704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:20.791488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Launched 18:54:21.050519 run iperf3-srv_10.42.42.10(pid=3333): Launched 18:54:21.164177 tst iperf3m4.py:8: start network... 18:54:21.365540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:21.827859 run create_hlr_db(pid=3334): Launched 18:54:21.949851 bus /gobi_6: Setting Powered False 18:54:23.009435 run create_hlr_db(pid=3334): Terminated: ok {rc=0} 18:54:23.447128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3336): Launched 18:54:23.766202 run osmo-hlr_10.42.42.2(pid=3337): Launched 18:54:23.887276 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:24.446385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3339): Launched 18:54:24.765663 run osmo-stp_10.42.42.5(pid=3340): Launched 18:54:24.887197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:25.443497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3342): Launched 18:54:25.567523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:25.840252 run patchelf(pid=3343): Launched 18:54:26.019382 run osmo-stp_10.42.42.5(pid=3340): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3340)] 18:54:26.156673 run osmo-stp_10.42.42.5(pid=3340): stdout: | (launched: 2022-12-09_18:54:24.707358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:26.295187 run osmo-stp_10.42.42.5(pid=3340): stderr: | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185424895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:26.433824 run osmo-stp_10.42.42.5(pid=3340): stdout: | (launched: 2022-12-09_18:54:24.707358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:26.566699 run osmo-stp_10.42.42.5(pid=3340): stderr: | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185424895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185424895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185424896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:26.723995 run patchelf(pid=3343): Terminating (SIGINT) 18:54:26.904686 run patchelf(pid=3343): Terminated: ok {rc=0} 18:54:27.035628 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3340): Process ended prematurely: osmo-stp_10.42.42.5(pid=3340) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3340)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:54:27.045745 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:54:27.074565 run osmo-hlr_10.42.42.2(pid=3337): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3337)] 18:54:27.124614 run osmo-hlr_10.42.42.2(pid=3337): stdout: | (launched: 2022-12-09_18:54:23.708332) 18:54:27.175917 run osmo-hlr_10.42.42.2(pid=3337): stderr: | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185423901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185423913 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185423922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185423922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185423922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:27.227779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Terminating (SIGTERM) 18:54:27.269254 run iperf3-srv_10.42.42.10(pid=3327): Terminating (SIGTERM) 18:54:27.310904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminating (SIGTERM) 18:54:27.352539 run iperf3-srv_10.42.42.10(pid=3329): Terminating (SIGTERM) 18:54:27.394181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminating (SIGTERM) 18:54:27.435675 run iperf3-srv_10.42.42.10(pid=3331): Terminating (SIGTERM) 18:54:27.477042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Terminating (SIGTERM) 18:54:27.518642 run iperf3-srv_10.42.42.10(pid=3333): Terminating (SIGTERM) 18:54:27.559998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3336): Terminating (SIGTERM) 18:54:27.601738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3339): Terminating (SIGTERM) 18:54:27.643248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3342): Terminating (SIGTERM) 18:54:27.684813 --- ParallelTerminationStrategy: PID 3326 died... 18:54:27.704120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Terminated: ok {rc=0} 18:54:27.750457 --- ParallelTerminationStrategy: PID 3327 died... 18:54:27.769551 run iperf3-srv_10.42.42.10(pid=3327): Terminated {rc=256} 18:54:27.815369 --- ParallelTerminationStrategy: PID 3328 died... 18:54:27.834720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminated: ok {rc=0} 18:54:27.880682 --- ParallelTerminationStrategy: PID 3329 died... 18:54:27.899913 run iperf3-srv_10.42.42.10(pid=3329): Terminated {rc=256} 18:54:27.946100 --- ParallelTerminationStrategy: PID 3330 died... 18:54:27.965385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminated: ok {rc=0} 18:54:28.011416 --- ParallelTerminationStrategy: PID 3331 died... 18:54:28.030618 run iperf3-srv_10.42.42.10(pid=3331): Terminated {rc=256} 18:54:28.076642 --- ParallelTerminationStrategy: PID 3332 died... 18:54:28.095913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Terminated: ok {rc=0} 18:54:28.142241 --- ParallelTerminationStrategy: PID 3333 died... 18:54:28.161603 run iperf3-srv_10.42.42.10(pid=3333): Terminated {rc=256} 18:54:28.207903 --- ParallelTerminationStrategy: PID 3336 died... 18:54:28.227126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3336): Terminated: ok {rc=0} 18:54:28.273444 --- ParallelTerminationStrategy: PID 3339 died... 18:54:28.292798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3339): Terminated: ok {rc=0} 18:54:28.339076 --- ParallelTerminationStrategy: PID 3342 died... 18:54:28.358529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3342): Terminated: ok {rc=0} 18:54:28.446807 bus /gobi_4: Setting Powered False 18:54:29.545589 bus /gobi_4: Setting Powered False 18:54:30.664138 bus /gobi_1: Setting Powered False 18:54:31.762301 bus /gobi_1: Setting Powered False 18:54:32.880454 bus /gobi_0: Setting Powered False 18:54:33.976610 bus /gobi_0: Setting Powered False 18:54:35.092206 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:54:36.194416 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.206341 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:54:36.265098 tst ping.py: using LAC 23027 18:54:36.390485 tst ping.py: using RAC 77 18:54:36.514261 tst ping.py: using CellId 23027 18:54:36.643301 tst ping.py: using BVCI 23028 18:54:36.760551 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.771876 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.782951 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.794252 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.805515 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.816611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.827944 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:36.839307 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:36.955816 tst ping.py:19: start network... 18:54:37.171673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:37.665344 run create_hlr_db(pid=3344): Launched 18:54:37.787340 bus /gobi_6: Setting Powered False 18:54:38.850170 run create_hlr_db(pid=3344): Terminated: ok {rc=0} 18:54:39.275813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Launched 18:54:39.573648 run osmo-hlr_10.42.42.2(pid=3347): Launched 18:54:39.687022 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:40.201091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Launched 18:54:40.499360 run osmo-stp_10.42.42.5(pid=3350): Launched 18:54:40.613140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:41.126186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3352): Launched 18:54:41.239406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:41.491374 run patchelf(pid=3353): Launched 18:54:41.656412 run osmo-stp_10.42.42.5(pid=3350): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] 18:54:41.782254 run osmo-stp_10.42.42.5(pid=3350): stdout: | (launched: 2022-12-09_18:54:40.444121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:41.909216 run osmo-stp_10.42.42.5(pid=3350): stderr: | [0;m[38;5;43m20221209185440612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185440613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185440613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185440613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:42.036385 run osmo-stp_10.42.42.5(pid=3350): stdout: | (launched: 2022-12-09_18:54:40.444121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:42.158288 run osmo-stp_10.42.42.5(pid=3350): stderr: | [0;m[38;5;43m20221209185440612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185440613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185440613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185440613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:42.302563 run patchelf(pid=3353): Terminating (SIGINT) 18:54:42.469145 run patchelf(pid=3353): Terminated: ok {rc=0} 18:54:42.589447 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3350): Process ended prematurely: osmo-stp_10.42.42.5(pid=3350) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 18:54:42.598329 tst ping.py:22: Test FAILED (6.4 sec) 18:54:42.624570 run osmo-hlr_10.42.42.2(pid=3347): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3347)] 18:54:42.672040 run osmo-hlr_10.42.42.2(pid=3347): stdout: | (launched: 2022-12-09_18:54:39.519023) 18:54:42.720848 run osmo-hlr_10.42.42.2(pid=3347): stderr: | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185439693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185439736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185439746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185439746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185439746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:42.769937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Terminating (SIGTERM) 18:54:42.809528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Terminating (SIGTERM) 18:54:42.848850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3352): Terminating (SIGTERM) 18:54:42.888310 --- ParallelTerminationStrategy: PID 3346 died... 18:54:42.907256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Terminated: ok {rc=0} 18:54:42.950859 --- ParallelTerminationStrategy: PID 3349 died... 18:54:42.969193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Terminated: ok {rc=0} 18:54:43.012594 --- ParallelTerminationStrategy: PID 3352 died... 18:54:43.031004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3352): Terminated: ok {rc=0} 18:54:43.116090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:54:44.203945 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.215763 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:54:44.274293 tst ping_idle_ping.py: using LAC 23028 18:54:44.392400 tst ping_idle_ping.py: using RAC 78 18:54:44.512181 tst ping_idle_ping.py: using CellId 23028 18:54:44.629271 tst ping_idle_ping.py: using BVCI 23029 18:54:44.738324 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.749143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.759644 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.770257 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.780627 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.791134 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.801783 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:54:44.812269 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:54:44.928904 tst ping_idle_ping.py:24: start network... 18:54:45.146219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:45.648739 run create_hlr_db(pid=3354): Launched 18:54:45.772427 bus /gobi_6: Setting Powered False 18:54:46.831933 run create_hlr_db(pid=3354): Terminated: ok {rc=0} 18:54:47.288515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3356): Launched 18:54:47.600175 run osmo-hlr_10.42.42.2(pid=3357): Launched 18:54:47.713859 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:48.225321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3359): Launched 18:54:48.523637 run osmo-stp_10.42.42.5(pid=3360): Launched 18:54:48.636856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:49.150427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3362): Launched 18:54:49.263501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:49.515305 run patchelf(pid=3363): Launched 18:54:49.680484 run osmo-stp_10.42.42.5(pid=3360): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3360)] 18:54:49.806059 run osmo-stp_10.42.42.5(pid=3360): stdout: | (launched: 2022-12-09_18:54:48.468320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:49.933187 run osmo-stp_10.42.42.5(pid=3360): stderr: | [0;m[38;5;43m20221209185448638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185448638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185448639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185448639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:50.060094 run osmo-stp_10.42.42.5(pid=3360): stdout: | (launched: 2022-12-09_18:54:48.468320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:50.181867 run osmo-stp_10.42.42.5(pid=3360): stderr: | [0;m[38;5;43m20221209185448638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185448638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185448639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185448639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185448640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:50.326278 run patchelf(pid=3363): Terminating (SIGINT) 18:54:50.492502 run patchelf(pid=3363): Terminated: ok {rc=0} 18:54:50.612094 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3360): Process ended prematurely: osmo-stp_10.42.42.5(pid=3360) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3360)] [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:54:50.620943 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:54:50.646851 run osmo-hlr_10.42.42.2(pid=3357): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3357)] 18:54:50.693557 run osmo-hlr_10.42.42.2(pid=3357): stdout: | (launched: 2022-12-09_18:54:47.544658) 18:54:50.741820 run osmo-hlr_10.42.42.2(pid=3357): stderr: | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185447719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185447733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185447742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185447742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185447742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:50.790379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3356): Terminating (SIGTERM) 18:54:50.829473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3359): Terminating (SIGTERM) 18:54:50.868193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3362): Terminating (SIGTERM) 18:54:50.906989 --- ParallelTerminationStrategy: PID 3356 died... 18:54:50.925676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3356): Terminated: ok {rc=0} 18:54:50.968434 --- ParallelTerminationStrategy: PID 3359 died... 18:54:50.986419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3359): Terminated: ok {rc=0} 18:54:51.029136 --- ParallelTerminationStrategy: PID 3362 died... 18:54:51.047217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3362): Terminated: ok {rc=0} 18:54:51.132012 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:54:52.428725 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:54:52.435243 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:54:52.455936 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:54:52.489519 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:54:52.541912 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:54:52.562523 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:54:52.595881 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:54:53.158484 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:54:53.164475 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.175499 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:54:53.237758 tst switch_tch_pdch.py: using LAC 23029 18:54:53.354923 tst switch_tch_pdch.py: using RAC 79 18:54:53.471415 tst switch_tch_pdch.py: using CellId 23029 18:54:53.589127 tst switch_tch_pdch.py: using BVCI 23030 18:54:53.696065 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.707140 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.717934 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.728655 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.739421 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.750238 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.761067 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:54:53.771800 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:54:53.890260 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:54:54.005487 tst switch_tch_pdch.py:51: start network... 18:54:54.204938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:54.665420 run create_hlr_db(pid=3367): Launched 18:54:54.787030 bus /gobi_6: Setting Powered False 18:54:55.846312 run create_hlr_db(pid=3367): Terminated: ok {rc=0} 18:54:56.280691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Launched 18:54:56.598439 run osmo-hlr_10.42.42.2(pid=3370): Launched 18:54:56.720085 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:57.270897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Launched 18:54:57.588862 run osmo-stp_10.42.42.5(pid=3373): Launched 18:54:57.710071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:58.258971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Launched 18:54:58.379682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:58.647320 run patchelf(pid=3376): Launched 18:54:58.822815 run osmo-stp_10.42.42.5(pid=3373): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] 18:54:58.956647 run osmo-stp_10.42.42.5(pid=3373): stdout: | (launched: 2022-12-09_18:54:57.530533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:59.092724 run osmo-stp_10.42.42.5(pid=3373): stderr: | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185457721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:59.228883 run osmo-stp_10.42.42.5(pid=3373): stdout: | (launched: 2022-12-09_18:54:57.530533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:59.358836 run osmo-stp_10.42.42.5(pid=3373): stderr: | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185457720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185457721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185457721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:59.512859 run patchelf(pid=3376): Terminating (SIGINT) 18:54:59.690221 run patchelf(pid=3376): Terminated: ok {rc=0} 18:54:59.818066 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3373): Process ended prematurely: osmo-stp_10.42.42.5(pid=3373) [trial-2363↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] [trial-2363↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:54:59.827472 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:54:59.855626 run osmo-hlr_10.42.42.2(pid=3370): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3370)] 18:54:59.905102 run osmo-hlr_10.42.42.2(pid=3370): stdout: | (launched: 2022-12-09_18:54:56.540072) 18:54:59.956189 run osmo-hlr_10.42.42.2(pid=3370): stderr: | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185456735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185456750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185456758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185456759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185456759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:00.007757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Terminating (SIGTERM) 18:55:00.049169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Terminating (SIGTERM) 18:55:00.090635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Terminating (SIGTERM) 18:55:00.132441 --- ParallelTerminationStrategy: PID 3369 died... 18:55:00.152081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Terminated: ok {rc=0} 18:55:00.199014 --- ParallelTerminationStrategy: PID 3372 died... 18:55:00.218177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Terminated: ok {rc=0} 18:55:00.263788 --- ParallelTerminationStrategy: PID 3375 died... 18:55:00.282996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Terminated: ok {rc=0} 18:55:00.369462 bus /gobi_0: Setting Powered False 18:55:01.471904 bus /gobi_0: Setting Powered False 18:55:02.587296 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:55:03.825590 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:03.831485 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:55:03.852887 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:55:03.888538 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:55:03.942589 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:55:03.963445 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:55:03.998295 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:55:04.552699 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:55:04.557977 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:04.569106 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:55:04.632597 tst switch_tch_pdch.py: using LAC 23030 18:55:04.757661 tst switch_tch_pdch.py: using RAC 80 18:55:04.883518 tst switch_tch_pdch.py: using CellId 23030 18:55:05.006403 tst switch_tch_pdch.py: using BVCI 23031 18:55:05.121648 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.133305 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.144229 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.155452 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.166658 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.178094 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.189501 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:55:05.200634 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:55:05.315060 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:55:05.430044 tst switch_tch_pdch.py:51: start network... 18:55:05.631216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:06.066286 run create_hlr_db(pid=3384): Launched 18:55:06.189490 bus /gobi_6: Setting Powered False 18:55:07.249224 run create_hlr_db(pid=3384): Terminated: ok {rc=0} 18:55:07.656883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Launched 18:55:07.974260 run osmo-hlr_10.42.42.2(pid=3387): Launched 18:55:08.097534 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:08.617642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Launched 18:55:08.934988 run osmo-stp_10.42.42.5(pid=3390): Launched 18:55:09.055368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:09.574861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Launched 18:55:09.696261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:09.964375 run patchelf(pid=3393): Launched 18:55:10.140358 run osmo-stp_10.42.42.5(pid=3390): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] 18:55:10.275179 run osmo-stp_10.42.42.5(pid=3390): stdout: | (launched: 2022-12-09_18:55:08.876693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:10.411242 run osmo-stp_10.42.42.5(pid=3390): stderr: | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185509067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:10.547520 run osmo-stp_10.42.42.5(pid=3390): stdout: | (launched: 2022-12-09_18:55:08.876693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:10.677851 run osmo-stp_10.42.42.5(pid=3390): stderr: | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185509066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185509067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185509067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:10.832036 run patchelf(pid=3393): Terminating (SIGINT) 18:55:11.008573 run patchelf(pid=3393): Terminated: ok {rc=0} 18:55:11.136673 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3390): Process ended prematurely: osmo-stp_10.42.42.5(pid=3390) [trial-2363↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] [trial-2363↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:55:11.146347 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:55:11.174745 run osmo-hlr_10.42.42.2(pid=3387): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3387)] 18:55:11.224384 run osmo-hlr_10.42.42.2(pid=3387): stdout: | (launched: 2022-12-09_18:55:07.916674) 18:55:11.275530 run osmo-hlr_10.42.42.2(pid=3387): stderr: | [0;m[1;31m20221209185508113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185508113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185508113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185508124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185508132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185508133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185508133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:11.326984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Terminating (SIGTERM) 18:55:11.368706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Terminating (SIGTERM) 18:55:11.410043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Terminating (SIGTERM) 18:55:11.451473 --- ParallelTerminationStrategy: PID 3386 died... 18:55:11.471008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Terminated: ok {rc=0} 18:55:11.517311 --- ParallelTerminationStrategy: PID 3389 died... 18:55:11.536842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Terminated: ok {rc=0} 18:55:11.582473 --- ParallelTerminationStrategy: PID 3392 died... 18:55:11.601523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Terminated: ok {rc=0} 18:55:11.687341 bus /gobi_0: Setting Powered False 18:55:12.786023 bus /gobi_0: Setting Powered False 18:55:13.898898 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:trx-b200 --------------------------------------------------------------------- 18:55:15.125782 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:15.129523 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 18:55:15.161744 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 18:55:15.168332 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 18:55:15.218431 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 18:55:15.250644 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 18:55:15.257137 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 18:55:15.797766 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 18:55:15.802654 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 18:55:15.813219 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 18:55:15.891970 tst mo_mt_sms.py: using LAC 23031 18:55:16.023458 tst mo_mt_sms.py: using RAC 81 18:55:16.151320 tst mo_mt_sms.py: using CellId 23031 18:55:16.305776 tst mo_mt_sms.py: using BVCI 23032 18:55:16.416303 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 18:55:16.526917 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 18:55:16.643184 tst mo_mt_sms.py:9: start nitb and bts... 18:55:16.865753 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:17.513052 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3397): Launched 18:55:17.811673 run osmo-nitb_10.42.42.2(pid=3398): Launched 18:55:17.976003 run osmo-nitb_10.42.42.2(pid=3398): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3398)] 18:55:18.109514 run osmo-nitb_10.42.42.2(pid=3398): stdout: | (launched: 2022-12-09_18:55:17.757193) 18:55:18.244347 run osmo-nitb_10.42.42.2(pid=3398): stderr: | (launched: 2022-12-09_18:55:17.801635) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:18.379677 run osmo-nitb_10.42.42.2(pid=3398): stdout: | (launched: 2022-12-09_18:55:17.757193) 18:55:18.508790 run osmo-nitb_10.42.42.2(pid=3398): stderr: | (launched: 2022-12-09_18:55:17.801635) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3398): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3398) [trial-2363↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3398)] 18:55:18.923791 tst osmo-nitb_10.42.42.2(pid=3398): stdout: | (launched: 2022-12-09_18:55:17.757193) 18:55:19.044319 tst osmo-nitb_10.42.42.2(pid=3398): stderr: | (launched: 2022-12-09_18:55:17.801635) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:19.185788 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3398): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3398) [trial-2363↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3398)] [trial-2363↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 18:55:19.193948 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:55:19.200498 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3397): Terminating (SIGTERM) 18:55:19.408286 --- ParallelTerminationStrategy: PID 3397 died... 18:55:19.428307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3397): Terminated: ok {rc=0} 18:55:19.512354 bus /sierra_3: Setting Powered False 18:55:20.612720 bus /sierra_3: Setting Powered False 18:55:21.729748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:trx-b200 --------------------------------------------------------------------- 18:55:22.927610 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:22.931582 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 18:55:22.964436 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:55:22.990321 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 18:55:23.041891 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 18:55:23.074641 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:55:23.100691 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 18:55:23.645375 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 18:55:23.650245 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:23.660484 tst sms:trx-b200: Using 1 x bts (candidates: 1) 18:55:23.707555 tst mo_mt_sms.py: using LAC 23032 18:55:23.824931 tst mo_mt_sms.py: using RAC 82 18:55:23.941290 tst mo_mt_sms.py: using CellId 23032 18:55:24.057337 tst mo_mt_sms.py: using BVCI 23033 18:55:24.164575 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:24.175079 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:24.185370 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:24.195527 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:24.205795 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:24.215998 tst sms:trx-b200: Using 1 x modem (candidates: 2) 18:55:24.329808 tst sms:trx-b200: Using 1 x modem (candidates: 2) 18:55:24.443484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:24.904340 run create_hlr_db(pid=3403): Launched 18:55:25.025765 bus /sierra_2: Setting Powered False 18:55:26.085039 run create_hlr_db(pid=3403): Terminated: ok {rc=0} 18:55:26.520324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3405): Launched 18:55:26.839950 run osmo-hlr_10.42.42.2(pid=3406): Launched 18:55:26.961780 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:27.509266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3408): Launched 18:55:27.827035 run osmo-stp_10.42.42.5(pid=3409): Launched 18:55:27.948365 run osmo-msc_10.42.42.6: Starting osmo-msc 18:55:28.526387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3411): Launched 18:55:28.828039 run osmo-msc_10.42.42.6(pid=3412): Launched 18:55:28.994182 run osmo-stp_10.42.42.5(pid=3409): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3409)] 18:55:29.120094 run osmo-stp_10.42.42.5(pid=3409): stdout: | (launched: 2022-12-09_18:55:27.768707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:29.245249 run osmo-stp_10.42.42.5(pid=3409): stderr: | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185527958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:29.368379 run osmo-stp_10.42.42.5(pid=3409): stdout: | (launched: 2022-12-09_18:55:27.768707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:29.486966 run osmo-stp_10.42.42.5(pid=3409): stderr: | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185527958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185527958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185527959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:29.628721 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3409): Process ended prematurely: osmo-stp_10.42.42.5(pid=3409) [trial-2363↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3409)] [trial-2363↪sms:trx-b200↪mo_mt_sms.py:16] 18:55:29.636864 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 18:55:29.662742 run osmo-hlr_10.42.42.2(pid=3406): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3406)] 18:55:29.710226 run osmo-hlr_10.42.42.2(pid=3406): stdout: | (launched: 2022-12-09_18:55:26.782032) 18:55:29.759283 run osmo-hlr_10.42.42.2(pid=3406): stderr: | [0;m[1;31m20221209185526977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185526977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185526977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185526977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185526977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185526978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185526994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185527004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185527005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185527005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:29.828411 run osmo-msc_10.42.42.6(pid=3412): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3412)] 18:55:29.875862 run osmo-msc_10.42.42.6(pid=3412): stdout: | (launched: 2022-12-09_18:55:28.773552) 18:55:29.925083 run osmo-msc_10.42.42.6(pid=3412): stderr: | [0;m[38;5;43m20221209185529044 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185529044 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ef4becc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185529044 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185529044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185529044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185529044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185529046 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185529047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185529047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185529047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:55:29.974286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3405): Terminating (SIGTERM) 18:55:30.013784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3408): Terminating (SIGTERM) 18:55:30.053195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3411): Terminating (SIGTERM) 18:55:30.092820 --- ParallelTerminationStrategy: PID 3405 died... 18:55:30.111714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3405): Terminated: ok {rc=0} 18:55:30.155198 --- ParallelTerminationStrategy: PID 3408 died... 18:55:30.173685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3408): Terminated: ok {rc=0} 18:55:30.217166 --- ParallelTerminationStrategy: PID 3411 died... 18:55:30.235303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3411): Terminated: ok {rc=0} 18:55:30.320202 bus /sierra_3: Setting Powered False 18:55:31.429138 bus /sierra_3: Setting Powered False 18:55:32.561581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-b200 --------------------------------------------------------------------- 18:55:33.790121 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:33.794189 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 18:55:33.827360 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 18:55:33.833951 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 18:55:33.868503 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 18:55:33.901339 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 18:55:33.907886 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:55:34.427201 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:55:34.431970 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 18:55:34.442521 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 18:55:34.490134 tst assert_extension.py: using LAC 23033 18:55:34.609387 tst assert_extension.py: using RAC 83 18:55:34.726212 tst assert_extension.py: using CellId 23033 18:55:34.845088 tst assert_extension.py: using BVCI 23034 18:55:34.952099 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 18:55:35.068376 tst assert_extension.py:10: start nitb and bts... 18:55:35.284787 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:35.933750 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3417): Launched 18:55:36.253396 run osmo-nitb_10.42.42.2(pid=3418): Launched 18:55:36.428676 run osmo-nitb_10.42.42.2(pid=3418): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3418)] 18:55:36.570619 run osmo-nitb_10.42.42.2(pid=3418): stdout: | (launched: 2022-12-09_18:55:36.195076) 18:55:36.713911 run osmo-nitb_10.42.42.2(pid=3418): stderr: | (launched: 2022-12-09_18:55:36.242482) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:36.857073 run osmo-nitb_10.42.42.2(pid=3418): stdout: | (launched: 2022-12-09_18:55:36.195076) 18:55:36.994653 run osmo-nitb_10.42.42.2(pid=3418): stderr: | (launched: 2022-12-09_18:55:36.242482) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3418): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3418) [trial-2363↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3418)] 18:55:37.373828 tst osmo-nitb_10.42.42.2(pid=3418): stdout: | (launched: 2022-12-09_18:55:36.195076) 18:55:37.502423 tst osmo-nitb_10.42.42.2(pid=3418): stderr: | (launched: 2022-12-09_18:55:36.242482) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:37.654124 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3418): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3418) [trial-2363↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3418)] [trial-2363↪nitb_ussd:trx-b200↪assert_extension.py:12] 18:55:37.663378 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:55:37.670737 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3417): Terminating (SIGTERM) 18:55:37.881760 --- ParallelTerminationStrategy: PID 3417 died... 18:55:37.903408 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3417): Terminated: ok {rc=0} 18:55:37.990954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:trx-b200 --------------------------------------------------------------------- 18:55:39.161943 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:39.165641 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 18:55:39.199009 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:55:39.224860 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 18:55:39.260474 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 18:55:39.293634 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:55:39.319691 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:55:39.846826 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:55:39.852316 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:39.862959 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 18:55:39.911754 tst assert_extension.py: using LAC 23034 18:55:40.035625 tst assert_extension.py: using RAC 84 18:55:40.153585 tst assert_extension.py: using CellId 23034 18:55:40.269502 tst assert_extension.py: using BVCI 23035 18:55:40.377920 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:40.388501 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:40.398825 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:40.409637 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:40.420385 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:55:40.431270 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 18:55:40.547264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:41.040188 run create_hlr_db(pid=3422): Launched 18:55:41.161661 bus /sierra_2: Setting Powered False 18:55:42.224601 run create_hlr_db(pid=3422): Terminated: ok {rc=0} 18:55:42.667141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Launched 18:55:42.985206 run osmo-hlr_10.42.42.2(pid=3425): Launched 18:55:43.107228 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:43.658051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Launched 18:55:43.976705 run osmo-stp_10.42.42.5(pid=3428): Launched 18:55:44.098741 run osmo-msc_10.42.42.6: Starting osmo-msc 18:55:44.673107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Launched 18:55:44.990062 run osmo-msc_10.42.42.6(pid=3431): Launched 18:55:45.170455 run osmo-stp_10.42.42.5(pid=3428): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] 18:55:45.306049 run osmo-stp_10.42.42.5(pid=3428): stdout: | (launched: 2022-12-09_18:55:43.918339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:45.442383 run osmo-stp_10.42.42.5(pid=3428): stderr: | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185544110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:45.575845 run osmo-stp_10.42.42.5(pid=3428): stdout: | (launched: 2022-12-09_18:55:43.918339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:45.703251 run osmo-stp_10.42.42.5(pid=3428): stderr: | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185544110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185544110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185544111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:45.860333 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3428): Process ended prematurely: osmo-stp_10.42.42.5(pid=3428) [trial-2363↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] [trial-2363↪ussd:trx-b200↪assert_extension.py:17] 18:55:45.870399 tst assert_extension.py:17: Test FAILED (6.0 sec) 18:55:45.908225 run osmo-hlr_10.42.42.2(pid=3425): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3425)] 18:55:45.957954 run osmo-hlr_10.42.42.2(pid=3425): stdout: | (launched: 2022-12-09_18:55:42.926839) 18:55:46.009714 run osmo-hlr_10.42.42.2(pid=3425): stderr: | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185543123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185543135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185543143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185543143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185543144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:46.078797 run osmo-msc_10.42.42.6(pid=3431): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3431)] 18:55:46.127703 run osmo-msc_10.42.42.6(pid=3431): stdout: | (launched: 2022-12-09_18:55:44.932008) 18:55:46.177813 run osmo-msc_10.42.42.6(pid=3431): stderr: | [0;m[38;5;43m20221209185545249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185545249 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f597b4cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185545250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185545250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185545250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185545250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185545252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185545252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185545252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185545252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:55:46.229688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Terminating (SIGTERM) 18:55:46.271510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Terminating (SIGTERM) 18:55:46.327654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Terminating (SIGTERM) 18:55:46.384199 --- ParallelTerminationStrategy: PID 3424 died... 18:55:46.410164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Terminated: ok {rc=0} 18:55:46.469392 --- ParallelTerminationStrategy: PID 3427 died... 18:55:46.495148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Terminated: ok {rc=0} 18:55:46.557115 --- ParallelTerminationStrategy: PID 3430 died... 18:55:46.582595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Terminated: ok {rc=0} 18:55:46.694216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:55:47.922724 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:47.930892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:55:47.964058 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:55:47.990129 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:55:48.040250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:55:48.073020 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:55:48.098807 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:55:48.648934 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:55:48.697969 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:48.708796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:55:48.776371 tst mo_mt_call.py: using LAC 23035 18:55:48.894967 tst mo_mt_call.py: using RAC 85 18:55:49.014934 tst mo_mt_call.py: using CellId 23035 18:55:49.136622 tst mo_mt_call.py: using BVCI 23036 18:55:49.247350 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:49.258320 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:49.269021 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:49.279749 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:49.290553 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:49.301223 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:55:49.414498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:55:49.528317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:49.998367 run create_hlr_db(pid=3436): Launched 18:55:50.123019 bus /sierra_2: Setting Powered False 18:55:51.183683 run create_hlr_db(pid=3436): Terminated: ok {rc=0} 18:55:51.605168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3438): Launched 18:55:51.907373 run osmo-hlr_10.42.42.2(pid=3439): Launched 18:55:52.022668 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:52.540657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3441): Launched 18:55:52.842161 run osmo-stp_10.42.42.5(pid=3442): Launched 18:55:52.956481 run osmo-msc_10.42.42.6: Starting osmo-msc 18:55:53.502132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3444): Launched 18:55:53.803934 run osmo-msc_10.42.42.6(pid=3445): Launched 18:55:53.972314 run osmo-stp_10.42.42.5(pid=3442): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3442)] 18:55:54.100441 run osmo-stp_10.42.42.5(pid=3442): stdout: | (launched: 2022-12-09_18:55:52.786421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:54.228307 run osmo-stp_10.42.42.5(pid=3442): stderr: | [0;m[38;5;43m20221209185552954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185552954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185552955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185552955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:54.354101 run osmo-stp_10.42.42.5(pid=3442): stdout: | (launched: 2022-12-09_18:55:52.786421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:54.474350 run osmo-stp_10.42.42.5(pid=3442): stderr: | [0;m[38;5;43m20221209185552954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185552954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185552955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185552955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185552956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:54.618640 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3442): Process ended prematurely: osmo-stp_10.42.42.5(pid=3442) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3442)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:55:54.627493 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:55:54.653555 run osmo-hlr_10.42.42.2(pid=3439): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3439)] 18:55:54.700564 run osmo-hlr_10.42.42.2(pid=3439): stdout: | (launched: 2022-12-09_18:55:51.852058) 18:55:54.749253 run osmo-hlr_10.42.42.2(pid=3439): stderr: | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185552027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185552039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185552049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185552050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185552050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:54.816981 run osmo-msc_10.42.42.6(pid=3445): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3445)] 18:55:54.864075 run osmo-msc_10.42.42.6(pid=3445): stdout: | (launched: 2022-12-09_18:55:53.748502) 18:55:54.912700 run osmo-msc_10.42.42.6(pid=3445): stderr: | [0;m[38;5;43m20221209185554019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185554019 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb6fb78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185554019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185554019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185554019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185554019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185554021 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185554022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185554022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185554022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:55:54.961819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3438): Terminating (SIGTERM) 18:55:55.000736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3441): Terminating (SIGTERM) 18:55:55.039672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3444): Terminating (SIGTERM) 18:55:55.078910 --- ParallelTerminationStrategy: PID 3438 died... 18:55:55.097643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3438): Terminated: ok {rc=0} 18:55:55.140670 --- ParallelTerminationStrategy: PID 3441 died... 18:55:55.158779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3441): Terminated: ok {rc=0} 18:55:55.201854 --- ParallelTerminationStrategy: PID 3444 died... 18:55:55.220099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3444): Terminated: ok {rc=0} 18:55:55.304780 bus /sierra_3: Setting Powered False 18:55:56.404004 bus /sierra_3: Setting Powered False 18:55:57.518601 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:55:58.663466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:58.675136 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:55:58.749577 tst mo_mt_call_osmux.py: using LAC 23036 18:55:58.868171 tst mo_mt_call_osmux.py: using RAC 86 18:55:58.984795 tst mo_mt_call_osmux.py: using CellId 23036 18:55:59.101446 tst mo_mt_call_osmux.py: using BVCI 23037 18:55:59.213141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:59.223971 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:59.234668 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:59.245406 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:59.256246 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:55:59.266993 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:55:59.387768 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:55:59.507708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:00.009266 run create_hlr_db(pid=3447): Launched 18:56:00.132827 bus /sierra_2: Setting Powered False 18:56:01.192646 run create_hlr_db(pid=3447): Terminated: ok {rc=0} 18:56:01.632079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Launched 18:56:01.953652 run osmo-hlr_10.42.42.2(pid=3450): Launched 18:56:02.113887 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:02.722786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Launched 18:56:03.046178 run osmo-stp_10.42.42.5(pid=3453): Launched 18:56:03.170127 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:03.753696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Launched 18:56:04.076215 run osmo-msc_10.42.42.6(pid=3456): Launched 18:56:04.255762 run osmo-stp_10.42.42.5(pid=3453): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] 18:56:04.392401 run osmo-stp_10.42.42.5(pid=3453): stdout: | (launched: 2022-12-09_18:56:02.987509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:04.530708 run osmo-stp_10.42.42.5(pid=3453): stderr: | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185603176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:04.666337 run osmo-stp_10.42.42.5(pid=3453): stdout: | (launched: 2022-12-09_18:56:02.987509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:04.794941 run osmo-stp_10.42.42.5(pid=3453): stderr: | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185603176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185603176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185603177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:04.948850 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3453): Process ended prematurely: osmo-stp_10.42.42.5(pid=3453) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:56:04.958379 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:56:04.986041 run osmo-hlr_10.42.42.2(pid=3450): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3450)] 18:56:05.035503 run osmo-hlr_10.42.42.2(pid=3450): stdout: | (launched: 2022-12-09_18:56:01.897841) 18:56:05.086640 run osmo-hlr_10.42.42.2(pid=3450): stderr: | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185602191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185602216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185602228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185602228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185602228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:05.158161 run osmo-msc_10.42.42.6(pid=3456): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3456)] 18:56:05.207624 run osmo-msc_10.42.42.6(pid=3456): stdout: | (launched: 2022-12-09_18:56:04.017468) 18:56:05.258510 run osmo-msc_10.42.42.6(pid=3456): stderr: | [0;m[38;5;43m20221209185604338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185604338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1a6c95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185604338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185604338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185604338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185604339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185604340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185604341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185604341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185604341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:05.309935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Terminating (SIGTERM) 18:56:05.351031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Terminating (SIGTERM) 18:56:05.392304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Terminating (SIGTERM) 18:56:05.433957 --- ParallelTerminationStrategy: PID 3449 died... 18:56:05.453695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Terminated: ok {rc=0} 18:56:05.499681 --- ParallelTerminationStrategy: PID 3452 died... 18:56:05.518863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Terminated: ok {rc=0} 18:56:05.564784 --- ParallelTerminationStrategy: PID 3455 died... 18:56:05.584367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Terminated: ok {rc=0} 18:56:05.671498 bus /sierra_3: Setting Powered False 18:56:06.768441 bus /sierra_3: Setting Powered False 18:56:07.883027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:56:09.132811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:09.139839 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:56:09.174823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:56:09.202010 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:56:09.255061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:56:09.289359 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:56:09.316519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:56:09.866538 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:56:09.918441 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:09.929895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:56:09.999725 tst mo_mt_call.py: using LAC 23037 18:56:10.126343 tst mo_mt_call.py: using RAC 87 18:56:10.257384 tst mo_mt_call.py: using CellId 23037 18:56:10.381641 tst mo_mt_call.py: using BVCI 23038 18:56:10.492329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:10.503461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:10.514384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:10.525870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:10.537249 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:10.548430 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:56:10.667580 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:56:10.784044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:11.253210 run create_hlr_db(pid=3461): Launched 18:56:11.376362 bus /sierra_2: Setting Powered False 18:56:12.437247 run create_hlr_db(pid=3461): Terminated: ok {rc=0} 18:56:12.877835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3464): Launched 18:56:13.201563 run osmo-hlr_10.42.42.2(pid=3465): Launched 18:56:13.324001 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:13.883061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3467): Launched 18:56:14.208790 run osmo-stp_10.42.42.5(pid=3468): Launched 18:56:14.331466 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:14.915178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3470): Launched 18:56:15.240387 run osmo-msc_10.42.42.6(pid=3471): Launched 18:56:15.421277 run osmo-stp_10.42.42.5(pid=3468): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3468)] 18:56:15.557567 run osmo-stp_10.42.42.5(pid=3468): stdout: | (launched: 2022-12-09_18:56:14.149295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:15.694408 run osmo-stp_10.42.42.5(pid=3468): stderr: | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185614342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185614342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185614342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185614343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:15.833324 run osmo-stp_10.42.42.5(pid=3468): stdout: | (launched: 2022-12-09_18:56:14.149295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:15.980718 run osmo-stp_10.42.42.5(pid=3468): stderr: | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185614341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185614342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185614342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185614342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185614343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:16.146772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3468): Process ended prematurely: osmo-stp_10.42.42.5(pid=3468) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3468)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:56:16.157216 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:56:16.188011 run osmo-hlr_10.42.42.2(pid=3465): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3465)] 18:56:16.240342 run osmo-hlr_10.42.42.2(pid=3465): stdout: | (launched: 2022-12-09_18:56:13.142061) 18:56:16.293825 run osmo-hlr_10.42.42.2(pid=3465): stderr: | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185613338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185613350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185613359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185613359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185613359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:16.367451 run osmo-msc_10.42.42.6(pid=3471): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3471)] 18:56:16.419309 run osmo-msc_10.42.42.6(pid=3471): stdout: | (launched: 2022-12-09_18:56:15.181434) 18:56:16.472555 run osmo-msc_10.42.42.6(pid=3471): stderr: | [0;m[38;5;43m20221209185615502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185615502 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b925adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185615502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185615502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185615502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185615502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185615504 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185615504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185615505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185615505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:16.526307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3464): Terminating (SIGTERM) 18:56:16.569896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3467): Terminating (SIGTERM) 18:56:16.613401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3470): Terminating (SIGTERM) 18:56:16.657118 --- ParallelTerminationStrategy: PID 3464 died... 18:56:16.677302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3464): Terminated: ok {rc=0} 18:56:16.726135 --- ParallelTerminationStrategy: PID 3467 died... 18:56:16.746347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3467): Terminated: ok {rc=0} 18:56:16.795008 --- ParallelTerminationStrategy: PID 3470 died... 18:56:16.815419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3470): Terminated: ok {rc=0} 18:56:16.906464 bus /sierra_3: Setting Powered False 18:56:18.010901 bus /sierra_3: Setting Powered False 18:56:19.125614 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:56:20.273284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.285260 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:56:20.356920 tst mo_mt_call_osmux.py: using LAC 23038 18:56:20.484097 tst mo_mt_call_osmux.py: using RAC 88 18:56:20.609983 tst mo_mt_call_osmux.py: using CellId 23038 18:56:20.738297 tst mo_mt_call_osmux.py: using BVCI 23039 18:56:20.855325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.866879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.878178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.889790 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.901309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:56:20.913115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:56:21.029223 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:56:21.149124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:21.651345 run create_hlr_db(pid=3473): Launched 18:56:21.774353 bus /sierra_2: Setting Powered False 18:56:22.838233 run create_hlr_db(pid=3473): Terminated: ok {rc=0} 18:56:23.270580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Launched 18:56:23.573439 run osmo-hlr_10.42.42.2(pid=3476): Launched 18:56:23.688728 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:24.209211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Launched 18:56:24.511098 run osmo-stp_10.42.42.5(pid=3479): Launched 18:56:24.625347 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:25.177095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3481): Launched 18:56:25.479433 run osmo-msc_10.42.42.6(pid=3482): Launched 18:56:25.647803 run osmo-stp_10.42.42.5(pid=3479): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] 18:56:25.774640 run osmo-stp_10.42.42.5(pid=3479): stdout: | (launched: 2022-12-09_18:56:24.455974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:25.901825 run osmo-stp_10.42.42.5(pid=3479): stderr: | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185624626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:26.027988 run osmo-stp_10.42.42.5(pid=3479): stdout: | (launched: 2022-12-09_18:56:24.455974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:26.148410 run osmo-stp_10.42.42.5(pid=3479): stderr: | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185624626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185624626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185624627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:26.293854 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3479): Process ended prematurely: osmo-stp_10.42.42.5(pid=3479) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:56:26.302792 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:56:26.328935 run osmo-hlr_10.42.42.2(pid=3476): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3476)] 18:56:26.376268 run osmo-hlr_10.42.42.2(pid=3476): stdout: | (launched: 2022-12-09_18:56:23.518141) 18:56:26.425177 run osmo-hlr_10.42.42.2(pid=3476): stderr: | [0;m[1;31m20221209185623694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185623694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185623694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185623694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185623695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185623695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185623710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185623720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185623720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185623720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:26.492506 run osmo-msc_10.42.42.6(pid=3482): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3482)] 18:56:26.539385 run osmo-msc_10.42.42.6(pid=3482): stdout: | (launched: 2022-12-09_18:56:25.423871) 18:56:26.587625 run osmo-msc_10.42.42.6(pid=3482): stderr: | [0;m[38;5;43m20221209185625695 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185625695 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa87fb0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185625695 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185625695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185625695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185625696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185625698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185625699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185625699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185625699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:26.636192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Terminating (SIGTERM) 18:56:26.675000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Terminating (SIGTERM) 18:56:26.713798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3481): Terminating (SIGTERM) 18:56:26.752916 --- ParallelTerminationStrategy: PID 3475 died... 18:56:26.771712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Terminated: ok {rc=0} 18:56:26.814994 --- ParallelTerminationStrategy: PID 3478 died... 18:56:26.833339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Terminated: ok {rc=0} 18:56:26.876487 --- ParallelTerminationStrategy: PID 3481 died... 18:56:26.894791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3481): Terminated: ok {rc=0} 18:56:26.979030 bus /sierra_3: Setting Powered False 18:56:28.077291 bus /sierra_3: Setting Powered False 18:56:29.191085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:56:30.435380 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:30.441835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:56:30.474678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:56:30.500899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:56:30.551851 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:56:30.584327 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:56:30.610377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:56:31.206567 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:56:31.277641 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.289907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:56:31.357927 tst mo_mt_call.py: using LAC 23039 18:56:31.489513 tst mo_mt_call.py: using RAC 89 18:56:31.620143 tst mo_mt_call.py: using CellId 23039 18:56:31.743981 tst mo_mt_call.py: using BVCI 23040 18:56:31.866342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.879025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.892533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.905937 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.919443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:31.931840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:56:32.088018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:56:32.228737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:32.735597 run create_hlr_db(pid=3487): Launched 18:56:32.858607 bus /sierra_2: Setting Powered False 18:56:33.922124 run create_hlr_db(pid=3487): Terminated: ok {rc=0} 18:56:34.372727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3489): Launched 18:56:34.695450 run osmo-hlr_10.42.42.2(pid=3490): Launched 18:56:34.819003 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:35.377675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3492): Launched 18:56:35.701011 run osmo-stp_10.42.42.5(pid=3493): Launched 18:56:35.824132 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:36.410702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3495): Launched 18:56:36.735029 run osmo-msc_10.42.42.6(pid=3496): Launched 18:56:36.914718 run osmo-stp_10.42.42.5(pid=3493): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3493)] 18:56:37.050960 run osmo-stp_10.42.42.5(pid=3493): stdout: | (launched: 2022-12-09_18:56:35.641660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:37.187845 run osmo-stp_10.42.42.5(pid=3493): stderr: | [0;m[38;5;43m20221209185635833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185635833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185635834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185635834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185635834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185635835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185635835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:37.323597 run osmo-stp_10.42.42.5(pid=3493): stdout: | (launched: 2022-12-09_18:56:35.641660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:37.452258 run osmo-stp_10.42.42.5(pid=3493): stderr: | [0;m[38;5;43m20221209185635833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185635833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185635834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185635834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185635834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185635835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185635835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:37.606669 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3493): Process ended prematurely: osmo-stp_10.42.42.5(pid=3493) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3493)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:56:37.616056 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:56:37.644126 run osmo-hlr_10.42.42.2(pid=3490): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3490)] 18:56:37.693685 run osmo-hlr_10.42.42.2(pid=3490): stdout: | (launched: 2022-12-09_18:56:34.636764) 18:56:37.744780 run osmo-hlr_10.42.42.2(pid=3490): stderr: | [0;m[1;31m20221209185634832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185634832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185634833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185634833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185634833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185634833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185634845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185634853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185634853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185634853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:37.815865 run osmo-msc_10.42.42.6(pid=3496): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3496)] 18:56:37.865446 run osmo-msc_10.42.42.6(pid=3496): stdout: | (launched: 2022-12-09_18:56:36.675874) 18:56:37.916618 run osmo-msc_10.42.42.6(pid=3496): stderr: | [0;m[38;5;43m20221209185636996 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185636996 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc15918ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185636997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185636997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185636997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185636997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185636999 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185636999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185636999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185636999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:37.968232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3489): Terminating (SIGTERM) 18:56:38.009627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3492): Terminating (SIGTERM) 18:56:38.050974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3495): Terminating (SIGTERM) 18:56:38.092491 --- ParallelTerminationStrategy: PID 3489 died... 18:56:38.112117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3489): Terminated: ok {rc=0} 18:56:38.157928 --- ParallelTerminationStrategy: PID 3492 died... 18:56:38.177306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3492): Terminated: ok {rc=0} 18:56:38.223382 --- ParallelTerminationStrategy: PID 3495 died... 18:56:38.242484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3495): Terminated: ok {rc=0} 18:56:38.327927 bus /sierra_3: Setting Powered False 18:56:39.425549 bus /sierra_3: Setting Powered False 18:56:40.538168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:56:41.680188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:41.691988 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:56:41.760678 tst mo_mt_call_osmux.py: using LAC 23040 18:56:41.879104 tst mo_mt_call_osmux.py: using RAC 90 18:56:41.999598 tst mo_mt_call_osmux.py: using CellId 23040 18:56:42.120109 tst mo_mt_call_osmux.py: using BVCI 23041 18:56:42.230931 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:42.242030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:42.252727 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:42.263494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:42.274302 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:56:42.285018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:56:42.404036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:56:42.518840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:42.989577 run create_hlr_db(pid=3498): Launched 18:56:43.112800 bus /sierra_2: Setting Powered False 18:56:44.173397 run create_hlr_db(pid=3498): Terminated: ok {rc=0} 18:56:44.615082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3500): Launched 18:56:44.938350 run osmo-hlr_10.42.42.2(pid=3501): Launched 18:56:45.060539 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:45.618782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3503): Launched 18:56:45.949477 run osmo-stp_10.42.42.5(pid=3504): Launched 18:56:46.192515 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:46.854026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3506): Launched 18:56:47.179315 run osmo-msc_10.42.42.6(pid=3507): Launched 18:56:47.350377 run osmo-stp_10.42.42.5(pid=3504): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3504)] 18:56:47.480840 run osmo-stp_10.42.42.5(pid=3504): stdout: | (launched: 2022-12-09_18:56:45.886048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:47.609918 run osmo-stp_10.42.42.5(pid=3504): stderr: | [0;m[38;5;43m20221209185646181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185646181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185646182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185646182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:47.736373 run osmo-stp_10.42.42.5(pid=3504): stdout: | (launched: 2022-12-09_18:56:45.886048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:47.857140 run osmo-stp_10.42.42.5(pid=3504): stderr: | [0;m[38;5;43m20221209185646181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185646181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185646182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185646182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185646183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:48.001574 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3504): Process ended prematurely: osmo-stp_10.42.42.5(pid=3504) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3504)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:56:48.010387 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:56:48.036504 run osmo-hlr_10.42.42.2(pid=3501): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3501)] 18:56:48.083551 run osmo-hlr_10.42.42.2(pid=3501): stdout: | (launched: 2022-12-09_18:56:44.879396) 18:56:48.132420 run osmo-hlr_10.42.42.2(pid=3501): stderr: | [0;m[1;31m20221209185645076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185645076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185645076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185645076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185645076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185645077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185645089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185645097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185645097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185645097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:48.200118 run osmo-msc_10.42.42.6(pid=3507): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3507)] 18:56:48.246910 run osmo-msc_10.42.42.6(pid=3507): stdout: | (launched: 2022-12-09_18:56:47.119492) 18:56:48.295323 run osmo-msc_10.42.42.6(pid=3507): stderr: | [0;m[38;5;43m20221209185647394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185647395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe77b01dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185647395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185647395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185647395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185647395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185647397 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185647397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185647398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185647398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:48.344857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3500): Terminating (SIGTERM) 18:56:48.383873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3503): Terminating (SIGTERM) 18:56:48.423620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3506): Terminating (SIGTERM) 18:56:48.462985 --- ParallelTerminationStrategy: PID 3500 died... 18:56:48.481691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3500): Terminated: ok {rc=0} 18:56:48.524829 --- ParallelTerminationStrategy: PID 3503 died... 18:56:48.543215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3503): Terminated: ok {rc=0} 18:56:48.586253 --- ParallelTerminationStrategy: PID 3506 died... 18:56:48.604717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3506): Terminated: ok {rc=0} 18:56:48.688643 bus /sierra_3: Setting Powered False 18:56:49.785931 bus /sierra_3: Setting Powered False 18:56:50.898949 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:56:52.144909 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:52.151179 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:56:52.183699 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:56:52.210171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:56:52.261520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:56:52.293899 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:56:52.319815 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:56:52.875555 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:56:52.927641 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:52.939105 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:56:53.009605 tst mo_mt_call.py: using LAC 23041 18:56:53.129162 tst mo_mt_call.py: using RAC 91 18:56:53.248942 tst mo_mt_call.py: using CellId 23041 18:56:53.367826 tst mo_mt_call.py: using BVCI 23042 18:56:53.479049 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:53.490158 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:53.501092 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:53.511939 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:53.522793 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:56:53.533546 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:56:53.650519 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:56:53.765043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:54.267123 run create_hlr_db(pid=3512): Launched 18:56:54.391706 bus /sierra_2: Setting Powered False 18:56:55.455193 run create_hlr_db(pid=3512): Terminated: ok {rc=0} 18:56:55.889054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3514): Launched 18:56:56.192302 run osmo-hlr_10.42.42.2(pid=3515): Launched 18:56:56.307726 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:56.845467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3517): Launched 18:56:57.147652 run osmo-stp_10.42.42.5(pid=3518): Launched 18:56:57.262722 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:57.812235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3520): Launched 18:56:58.115343 run osmo-msc_10.42.42.6(pid=3521): Launched 18:56:58.283669 run osmo-stp_10.42.42.5(pid=3518): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3518)] 18:56:58.411316 run osmo-stp_10.42.42.5(pid=3518): stdout: | (launched: 2022-12-09_18:56:57.091868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:58.539534 run osmo-stp_10.42.42.5(pid=3518): stderr: | [0;m[38;5;43m20221209185657263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185657264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185657264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185657264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:58.665100 run osmo-stp_10.42.42.5(pid=3518): stdout: | (launched: 2022-12-09_18:56:57.091868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:58.785244 run osmo-stp_10.42.42.5(pid=3518): stderr: | [0;m[38;5;43m20221209185657263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185657264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185657264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185657264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185657265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:58.929403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3518): Process ended prematurely: osmo-stp_10.42.42.5(pid=3518) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3518)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:56:58.938270 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:56:58.964059 run osmo-hlr_10.42.42.2(pid=3515): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3515)] 18:56:59.011190 run osmo-hlr_10.42.42.2(pid=3515): stdout: | (launched: 2022-12-09_18:56:56.136009) 18:56:59.059561 run osmo-hlr_10.42.42.2(pid=3515): stderr: | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185656309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185656321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185656330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185656330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185656330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:59.126567 run osmo-msc_10.42.42.6(pid=3521): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3521)] 18:56:59.173157 run osmo-msc_10.42.42.6(pid=3521): stdout: | (launched: 2022-12-09_18:56:58.059613) 18:56:59.221626 run osmo-msc_10.42.42.6(pid=3521): stderr: | [0;m[38;5;43m20221209185658333 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185658334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7989addc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185658334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185658334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185658334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185658334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185658336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185658336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185658336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185658337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:59.270225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3514): Terminating (SIGTERM) 18:56:59.309025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3517): Terminating (SIGTERM) 18:56:59.347976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3520): Terminating (SIGTERM) 18:56:59.387007 --- ParallelTerminationStrategy: PID 3514 died... 18:56:59.405612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3514): Terminated: ok {rc=0} 18:56:59.449099 --- ParallelTerminationStrategy: PID 3517 died... 18:56:59.467322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3517): Terminated: ok {rc=0} 18:56:59.510297 --- ParallelTerminationStrategy: PID 3520 died... 18:56:59.528510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3520): Terminated: ok {rc=0} 18:56:59.609876 bus /sierra_3: Setting Powered False 18:57:00.706104 bus /sierra_3: Setting Powered False 18:57:01.824612 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:57:02.969587 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:02.980915 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:57:03.049623 tst mo_mt_call_osmux.py: using LAC 23042 18:57:03.170507 tst mo_mt_call_osmux.py: using RAC 92 18:57:03.293974 tst mo_mt_call_osmux.py: using CellId 23042 18:57:03.412679 tst mo_mt_call_osmux.py: using BVCI 23043 18:57:03.521581 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:03.532641 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:03.543372 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:03.554091 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:03.565106 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:57:03.575806 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:57:03.695467 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:57:03.816388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:04.317998 run create_hlr_db(pid=3523): Launched 18:57:04.442681 bus /sierra_2: Setting Powered False 18:57:05.506068 run create_hlr_db(pid=3523): Terminated: ok {rc=0} 18:57:05.957041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Launched 18:57:06.282501 run osmo-hlr_10.42.42.2(pid=3526): Launched 18:57:06.407309 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:06.965248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Launched 18:57:07.289561 run osmo-stp_10.42.42.5(pid=3529): Launched 18:57:07.413773 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:08.002835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Launched 18:57:08.328577 run osmo-msc_10.42.42.6(pid=3532): Launched 18:57:08.511046 run osmo-stp_10.42.42.5(pid=3529): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] 18:57:08.648834 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-09_18:57:07.230220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:08.786927 run osmo-stp_10.42.42.5(pid=3529): stderr: | [0;m[38;5;43m20221209185707422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185707422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185707423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185707423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:08.923632 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-09_18:57:07.230220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:09.052709 run osmo-stp_10.42.42.5(pid=3529): stderr: | [0;m[38;5;43m20221209185707422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185707422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185707423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185707423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185707424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:09.208576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:57:09.218195 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:57:09.245944 run osmo-hlr_10.42.42.2(pid=3526): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3526)] 18:57:09.295723 run osmo-hlr_10.42.42.2(pid=3526): stdout: | (launched: 2022-12-09_18:57:06.223785) 18:57:09.346965 run osmo-hlr_10.42.42.2(pid=3526): stderr: | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185706421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185706434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185706442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185706442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185706442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:09.418543 run osmo-msc_10.42.42.6(pid=3532): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3532)] 18:57:09.467964 run osmo-msc_10.42.42.6(pid=3532): stdout: | (launched: 2022-12-09_18:57:08.269207) 18:57:09.518824 run osmo-msc_10.42.42.6(pid=3532): stderr: | [0;m[38;5;43m20221209185708594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185708594 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9877173c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185708594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185708594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185708594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185708594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185708596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185708596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185708596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185708597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:09.570094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminating (SIGTERM) 18:57:09.611380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminating (SIGTERM) 18:57:09.652646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Terminating (SIGTERM) 18:57:09.694414 --- ParallelTerminationStrategy: PID 3525 died... 18:57:09.713977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminated: ok {rc=0} 18:57:09.760032 --- ParallelTerminationStrategy: PID 3528 died... 18:57:09.779153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminated: ok {rc=0} 18:57:09.825047 --- ParallelTerminationStrategy: PID 3531 died... 18:57:09.844139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Terminated: ok {rc=0} 18:57:09.931915 bus /sierra_3: Setting Powered False 18:57:11.029439 bus /sierra_3: Setting Powered False 18:57:12.146967 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:57:13.398034 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:13.405616 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:57:13.438256 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:57:13.464755 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:57:13.515280 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:57:13.547869 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:57:13.574017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:57:14.124817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:57:14.173726 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.184745 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:57:14.253328 tst mo_mt_call.py: using LAC 23043 18:57:14.373497 tst mo_mt_call.py: using RAC 93 18:57:14.502466 tst mo_mt_call.py: using CellId 23043 18:57:14.630927 tst mo_mt_call.py: using BVCI 23044 18:57:14.749592 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.760998 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.772147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.783741 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.795282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:14.806872 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:57:14.923284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:57:15.043830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:15.547022 run create_hlr_db(pid=3537): Launched 18:57:15.670133 bus /sierra_2: Setting Powered False 18:57:16.750132 run create_hlr_db(pid=3537): Terminated: ok {rc=0} 18:57:17.192222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3539): Launched 18:57:17.526206 run osmo-hlr_10.42.42.2(pid=3540): Launched 18:57:17.649176 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:18.209975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3542): Launched 18:57:18.533747 run osmo-stp_10.42.42.5(pid=3543): Launched 18:57:18.656434 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:19.241725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3545): Launched 18:57:19.566843 run osmo-msc_10.42.42.6(pid=3546): Launched 18:57:19.747790 run osmo-stp_10.42.42.5(pid=3543): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3543)] 18:57:19.883936 run osmo-stp_10.42.42.5(pid=3543): stdout: | (launched: 2022-12-09_18:57:18.474574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:20.020891 run osmo-stp_10.42.42.5(pid=3543): stderr: | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185718667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:20.157172 run osmo-stp_10.42.42.5(pid=3543): stdout: | (launched: 2022-12-09_18:57:18.474574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:20.286944 run osmo-stp_10.42.42.5(pid=3543): stderr: | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185718666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185718667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185718667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:20.441456 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3543): Process ended prematurely: osmo-stp_10.42.42.5(pid=3543) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3543)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:57:20.451221 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:57:20.479374 run osmo-hlr_10.42.42.2(pid=3540): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3540)] 18:57:20.529438 run osmo-hlr_10.42.42.2(pid=3540): stdout: | (launched: 2022-12-09_18:57:17.466847) 18:57:20.581085 run osmo-hlr_10.42.42.2(pid=3540): stderr: | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185717665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185717681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185717691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185717691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185717691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:20.652739 run osmo-msc_10.42.42.6(pid=3546): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3546)] 18:57:20.702596 run osmo-msc_10.42.42.6(pid=3546): stdout: | (launched: 2022-12-09_18:57:19.507992) 18:57:20.754033 run osmo-msc_10.42.42.6(pid=3546): stderr: | [0;m[38;5;43m20221209185719829 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185719829 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5fb4d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185719829 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185719829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185719829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185719829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185719831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185719831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185719832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185719832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:20.805770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3539): Terminating (SIGTERM) 18:57:20.847090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3542): Terminating (SIGTERM) 18:57:20.888482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3545): Terminating (SIGTERM) 18:57:20.929970 --- ParallelTerminationStrategy: PID 3539 died... 18:57:20.949643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3539): Terminated: ok {rc=0} 18:57:20.995672 --- ParallelTerminationStrategy: PID 3542 died... 18:57:21.014776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3542): Terminated: ok {rc=0} 18:57:21.060770 --- ParallelTerminationStrategy: PID 3545 died... 18:57:21.080186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3545): Terminated: ok {rc=0} 18:57:21.167564 bus /sierra_3: Setting Powered False 18:57:22.266275 bus /sierra_3: Setting Powered False 18:57:23.383966 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:57:24.529928 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:24.541461 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:57:24.609963 tst mo_mt_call_osmux.py: using LAC 23044 18:57:24.737413 tst mo_mt_call_osmux.py: using RAC 94 18:57:24.865134 tst mo_mt_call_osmux.py: using CellId 23044 18:57:24.992495 tst mo_mt_call_osmux.py: using BVCI 23045 18:57:25.110059 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:25.121745 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:25.133107 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:25.144558 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:25.156173 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:57:25.167686 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:57:25.289749 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:57:25.407806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:25.877351 run create_hlr_db(pid=3548): Launched 18:57:26.003223 bus /sierra_2: Setting Powered False 18:57:27.063705 run create_hlr_db(pid=3548): Terminated: ok {rc=0} 18:57:27.486631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3550): Launched 18:57:27.790636 run osmo-hlr_10.42.42.2(pid=3551): Launched 18:57:27.917105 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:28.476419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3553): Launched 18:57:28.801209 run osmo-stp_10.42.42.5(pid=3554): Launched 18:57:28.926172 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:29.512850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3556): Launched 18:57:29.836997 run osmo-msc_10.42.42.6(pid=3557): Launched 18:57:30.018612 run osmo-stp_10.42.42.5(pid=3554): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3554)] 18:57:30.155714 run osmo-stp_10.42.42.5(pid=3554): stdout: | (launched: 2022-12-09_18:57:28.741916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:30.294011 run osmo-stp_10.42.42.5(pid=3554): stderr: | [0;m[38;5;43m20221209185728932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185728933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185728933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185728933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:30.430551 run osmo-stp_10.42.42.5(pid=3554): stdout: | (launched: 2022-12-09_18:57:28.741916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:30.560168 run osmo-stp_10.42.42.5(pid=3554): stderr: | [0;m[38;5;43m20221209185728932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185728933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185728933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185728933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185728934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:30.715715 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3554): Process ended prematurely: osmo-stp_10.42.42.5(pid=3554) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3554)] [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:57:30.725555 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:57:30.754064 run osmo-hlr_10.42.42.2(pid=3551): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3551)] 18:57:30.803985 run osmo-hlr_10.42.42.2(pid=3551): stdout: | (launched: 2022-12-09_18:57:27.733923) 18:57:30.860060 run osmo-hlr_10.42.42.2(pid=3551): stderr: | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185727925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185727938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185727946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185727946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185727946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:30.937448 run osmo-msc_10.42.42.6(pid=3557): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3557)] 18:57:30.988419 run osmo-msc_10.42.42.6(pid=3557): stdout: | (launched: 2022-12-09_18:57:29.778060) 18:57:31.039309 run osmo-msc_10.42.42.6(pid=3557): stderr: | [0;m[38;5;43m20221209185730099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185730099 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa95b46ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185730099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185730099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185730099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185730100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185730101 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185730102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185730102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185730102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:31.090842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3550): Terminating (SIGTERM) 18:57:31.132914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3553): Terminating (SIGTERM) 18:57:31.176670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3556): Terminating (SIGTERM) 18:57:31.221990 --- ParallelTerminationStrategy: PID 3550 died... 18:57:31.241583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3550): Terminated: ok {rc=0} 18:57:31.290232 --- ParallelTerminationStrategy: PID 3553 died... 18:57:31.309438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3553): Terminated: ok {rc=0} 18:57:31.355985 --- ParallelTerminationStrategy: PID 3556 died... 18:57:31.376181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3556): Terminated: ok {rc=0} 18:57:31.465926 bus /sierra_3: Setting Powered False 18:57:32.570053 bus /sierra_3: Setting Powered False 18:57:33.684869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:57:34.932942 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:34.939165 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:57:34.971581 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:57:34.997765 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:57:35.049525 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:57:35.082452 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:57:35.108378 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:57:35.662677 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:57:35.711358 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:35.722359 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:57:35.795715 tst mo_mt_call.py: using LAC 23045 18:57:35.915054 tst mo_mt_call.py: using RAC 95 18:57:36.033815 tst mo_mt_call.py: using CellId 23045 18:57:36.152087 tst mo_mt_call.py: using BVCI 23046 18:57:36.272053 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:36.283602 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:36.295400 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:36.307300 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:36.319050 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:36.330852 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:57:36.446206 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:57:36.565976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:37.069703 run create_hlr_db(pid=3566): Launched 18:57:37.192443 bus /sierra_2: Setting Powered False 18:57:38.256637 run create_hlr_db(pid=3566): Terminated: ok {rc=0} 18:57:38.708357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3568): Launched 18:57:39.032283 run osmo-hlr_10.42.42.2(pid=3569): Launched 18:57:39.156113 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:39.717087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3571): Launched 18:57:40.041643 run osmo-stp_10.42.42.5(pid=3572): Launched 18:57:40.164718 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:40.750488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3574): Launched 18:57:41.074116 run osmo-msc_10.42.42.6(pid=3575): Launched 18:57:41.256562 run osmo-stp_10.42.42.5(pid=3572): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3572)] 18:57:41.393559 run osmo-stp_10.42.42.5(pid=3572): stdout: | (launched: 2022-12-09_18:57:39.982426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:41.530222 run osmo-stp_10.42.42.5(pid=3572): stderr: | [0;m[38;5;43m20221209185740171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185740171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185740172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185740172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:41.666255 run osmo-stp_10.42.42.5(pid=3572): stdout: | (launched: 2022-12-09_18:57:39.982426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:41.795303 run osmo-stp_10.42.42.5(pid=3572): stderr: | [0;m[38;5;43m20221209185740171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185740171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185740172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185740172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185740173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:41.950021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3572): Process ended prematurely: osmo-stp_10.42.42.5(pid=3572) [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3572)] [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:57:41.959393 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:57:41.987265 run osmo-hlr_10.42.42.2(pid=3569): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3569)] 18:57:42.036623 run osmo-hlr_10.42.42.2(pid=3569): stdout: | (launched: 2022-12-09_18:57:38.972874) 18:57:42.087831 run osmo-hlr_10.42.42.2(pid=3569): stderr: | [0;m[1;31m20221209185739169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185739169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185739169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185739169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185739169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185739170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185739182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185739192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185739192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185739192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:42.158742 run osmo-msc_10.42.42.6(pid=3575): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3575)] 18:57:42.208270 run osmo-msc_10.42.42.6(pid=3575): stdout: | (launched: 2022-12-09_18:57:41.014971) 18:57:42.259220 run osmo-msc_10.42.42.6(pid=3575): stderr: | [0;m[38;5;43m20221209185741334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185741335 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a56031c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185741335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185741335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185741335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185741335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185741337 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185741337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185741337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185741337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:42.310582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3568): Terminating (SIGTERM) 18:57:42.351821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3571): Terminating (SIGTERM) 18:57:42.393024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3574): Terminating (SIGTERM) 18:57:42.434392 --- ParallelTerminationStrategy: PID 3568 died... 18:57:42.453963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3568): Terminated: ok {rc=0} 18:57:42.499688 --- ParallelTerminationStrategy: PID 3571 died... 18:57:42.518842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3571): Terminated: ok {rc=0} 18:57:42.564447 --- ParallelTerminationStrategy: PID 3574 died... 18:57:42.583754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3574): Terminated: ok {rc=0} 18:57:42.670500 bus /sierra_3: Setting Powered False 18:57:43.768431 bus /sierra_3: Setting Powered False 18:57:44.886175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:57:46.028691 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.040995 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:57:46.110809 tst mo_mt_call_osmux.py: using LAC 23046 18:57:46.285227 tst mo_mt_call_osmux.py: using RAC 96 18:57:46.407358 tst mo_mt_call_osmux.py: using CellId 23046 18:57:46.570274 tst mo_mt_call_osmux.py: using BVCI 23047 18:57:46.694031 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.706706 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.720098 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.733500 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.746985 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:57:46.759441 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:57:46.902060 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:57:47.029430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:47.569765 run create_hlr_db(pid=3578): Launched 18:57:47.695724 bus /sierra_2: Setting Powered False 18:57:48.760842 run create_hlr_db(pid=3578): Terminated: ok {rc=0} 18:57:49.214133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3580): Launched 18:57:49.519232 run osmo-hlr_10.42.42.2(pid=3581): Launched 18:57:49.635070 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:50.174154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3583): Launched 18:57:50.477652 run osmo-stp_10.42.42.5(pid=3584): Launched 18:57:50.593496 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:51.142823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3586): Launched 18:57:51.445138 run osmo-msc_10.42.42.6(pid=3587): Launched 18:57:51.615030 run osmo-stp_10.42.42.5(pid=3584): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3584)] 18:57:51.745451 run osmo-stp_10.42.42.5(pid=3584): stdout: | (launched: 2022-12-09_18:57:50.421709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:51.873261 run osmo-stp_10.42.42.5(pid=3584): stderr: | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185750593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:52.001937 run osmo-stp_10.42.42.5(pid=3584): stdout: | (launched: 2022-12-09_18:57:50.421709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:52.122457 run osmo-stp_10.42.42.5(pid=3584): stderr: | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185750592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185750593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185750593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:52.267063 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3584): Process ended prematurely: osmo-stp_10.42.42.5(pid=3584) [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3584)] [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:57:52.275927 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:57:52.301794 run osmo-hlr_10.42.42.2(pid=3581): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3581)] 18:57:52.348606 run osmo-hlr_10.42.42.2(pid=3581): stdout: | (launched: 2022-12-09_18:57:49.462808) 18:57:52.397366 run osmo-hlr_10.42.42.2(pid=3581): stderr: | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185749637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185749650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185749658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185749658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185749658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:52.465879 run osmo-msc_10.42.42.6(pid=3587): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3587)] 18:57:52.512714 run osmo-msc_10.42.42.6(pid=3587): stdout: | (launched: 2022-12-09_18:57:51.389580) 18:57:52.561184 run osmo-msc_10.42.42.6(pid=3587): stderr: | [0;m[38;5;43m20221209185751660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185751660 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f686184cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185751660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185751660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185751660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185751660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185751662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185751663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185751664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185751664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:52.609836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3580): Terminating (SIGTERM) 18:57:52.648393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3583): Terminating (SIGTERM) 18:57:52.686995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3586): Terminating (SIGTERM) 18:57:52.725814 --- ParallelTerminationStrategy: PID 3580 died... 18:57:52.744343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3580): Terminated: ok {rc=0} 18:57:52.787895 --- ParallelTerminationStrategy: PID 3583 died... 18:57:52.806165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3583): Terminated: ok {rc=0} 18:57:52.849094 --- ParallelTerminationStrategy: PID 3586 died... 18:57:52.867335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3586): Terminated: ok {rc=0} 18:57:52.951807 bus /sierra_3: Setting Powered False 18:57:54.050349 bus /sierra_3: Setting Powered False 18:57:55.164490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:57:56.412608 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:56.418624 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:57:56.451353 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:57:56.477440 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:57:56.528001 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:57:56.560369 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:57:56.586327 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:57:57.136672 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:57:57.185260 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.196000 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:57:57.265265 tst mo_mt_call.py: using LAC 23047 18:57:57.383874 tst mo_mt_call.py: using RAC 97 18:57:57.502248 tst mo_mt_call.py: using CellId 23047 18:57:57.623687 tst mo_mt_call.py: using BVCI 23048 18:57:57.743370 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.754826 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.766415 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.777977 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.789581 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:57:57.801413 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:57:57.920706 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:57:58.036085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:58.506982 run create_hlr_db(pid=3592): Launched 18:57:58.631353 bus /sierra_2: Setting Powered False 18:57:59.692551 run create_hlr_db(pid=3592): Terminated: ok {rc=0} 18:58:00.136802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Launched 18:58:00.464033 run osmo-hlr_10.42.42.2(pid=3595): Launched 18:58:00.588814 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:01.162592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Launched 18:58:01.504460 run osmo-stp_10.42.42.5(pid=3598): Launched 18:58:01.746442 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:02.409575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Launched 18:58:02.736451 run osmo-msc_10.42.42.6(pid=3601): Launched 18:58:02.919343 run osmo-stp_10.42.42.5(pid=3598): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] 18:58:03.056828 run osmo-stp_10.42.42.5(pid=3598): stdout: | (launched: 2022-12-09_18:58:01.442823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:03.194602 run osmo-stp_10.42.42.5(pid=3598): stderr: | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185801735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185801735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185801735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185801736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:03.331256 run osmo-stp_10.42.42.5(pid=3598): stdout: | (launched: 2022-12-09_18:58:01.442823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:03.461040 run osmo-stp_10.42.42.5(pid=3598): stderr: | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185801734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185801735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185801735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185801735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185801736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:03.616304 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3598): Process ended prematurely: osmo-stp_10.42.42.5(pid=3598) [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:58:03.625950 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:58:03.654026 run osmo-hlr_10.42.42.2(pid=3595): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3595)] 18:58:03.704026 run osmo-hlr_10.42.42.2(pid=3595): stdout: | (launched: 2022-12-09_18:58:00.404765) 18:58:03.755624 run osmo-hlr_10.42.42.2(pid=3595): stderr: | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185800603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185800615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185800625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185800626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185800626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:03.827319 run osmo-msc_10.42.42.6(pid=3601): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3601)] 18:58:03.877161 run osmo-msc_10.42.42.6(pid=3601): stdout: | (launched: 2022-12-09_18:58:02.677471) 18:58:03.928309 run osmo-msc_10.42.42.6(pid=3601): stderr: | [0;m[38;5;43m20221209185803000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185803000 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29c3b9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185803000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185803000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185803000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185803000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185803002 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185803003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185803003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185803003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:03.979976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Terminating (SIGTERM) 18:58:04.021394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Terminating (SIGTERM) 18:58:04.062951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminating (SIGTERM) 18:58:04.104780 --- ParallelTerminationStrategy: PID 3594 died... 18:58:04.124594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Terminated: ok {rc=0} 18:58:04.171148 --- ParallelTerminationStrategy: PID 3597 died... 18:58:04.190611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Terminated: ok {rc=0} 18:58:04.237155 --- ParallelTerminationStrategy: PID 3600 died... 18:58:04.256539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminated: ok {rc=0} 18:58:04.343581 bus /sierra_3: Setting Powered False 18:58:05.440342 bus /sierra_3: Setting Powered False 18:58:06.554594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:58:07.703238 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:07.715350 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:58:07.785927 tst mo_mt_call_osmux.py: using LAC 23048 18:58:07.913340 tst mo_mt_call_osmux.py: using RAC 98 18:58:08.039362 tst mo_mt_call_osmux.py: using CellId 23048 18:58:08.166412 tst mo_mt_call_osmux.py: using BVCI 23049 18:58:08.286443 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:08.297784 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:08.308761 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:08.320162 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:08.331755 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:58:08.343460 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:58:08.463543 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:58:08.584714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:09.089752 run create_hlr_db(pid=3603): Launched 18:58:09.213965 bus /sierra_2: Setting Powered False 18:58:10.278783 run create_hlr_db(pid=3603): Terminated: ok {rc=0} 18:58:10.715153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Launched 18:58:11.020023 run osmo-hlr_10.42.42.2(pid=3606): Launched 18:58:11.136784 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:11.664273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Launched 18:58:11.969386 run osmo-stp_10.42.42.5(pid=3609): Launched 18:58:12.084766 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:12.633878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Launched 18:58:12.936751 run osmo-msc_10.42.42.6(pid=3612): Launched 18:58:13.107084 run osmo-stp_10.42.42.5(pid=3609): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] 18:58:13.235775 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-09_18:58:11.912915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:13.363951 run osmo-stp_10.42.42.5(pid=3609): stderr: | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185812083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:13.490329 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-09_18:58:11.912915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:13.611414 run osmo-stp_10.42.42.5(pid=3609): stderr: | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185812082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185812083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185812083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:13.756176 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:58:13.765044 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:58:13.791043 run osmo-hlr_10.42.42.2(pid=3606): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3606)] 18:58:13.837790 run osmo-hlr_10.42.42.2(pid=3606): stdout: | (launched: 2022-12-09_18:58:10.963754) 18:58:13.886089 run osmo-hlr_10.42.42.2(pid=3606): stderr: | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185811137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185811150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185811158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185811158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185811158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:13.953586 run osmo-msc_10.42.42.6(pid=3612): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3612)] 18:58:14.000200 run osmo-msc_10.42.42.6(pid=3612): stdout: | (launched: 2022-12-09_18:58:12.881180) 18:58:14.048545 run osmo-msc_10.42.42.6(pid=3612): stderr: | [0;m[38;5;43m20221209185813152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185813152 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96c5912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185813152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185813152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185813152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185813152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185813154 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185813155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185813156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185813156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:14.097289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminating (SIGTERM) 18:58:14.136023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminating (SIGTERM) 18:58:14.174852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminating (SIGTERM) 18:58:14.213835 --- ParallelTerminationStrategy: PID 3605 died... 18:58:14.232304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminated: ok {rc=0} 18:58:14.275895 --- ParallelTerminationStrategy: PID 3608 died... 18:58:14.294213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminated: ok {rc=0} 18:58:14.337359 --- ParallelTerminationStrategy: PID 3611 died... 18:58:14.355775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminated: ok {rc=0} 18:58:14.441373 bus /sierra_3: Setting Powered False 18:58:15.540228 bus /sierra_3: Setting Powered False 18:58:16.656373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 18:58:17.919139 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:58:17.924252 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 18:58:17.956461 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 18:58:17.982502 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 18:58:18.032577 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 18:58:18.064876 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 18:58:18.090783 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 18:58:18.644438 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 18:58:18.697449 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:18.708770 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:58:18.758441 tst mo_mt_call.py: using LAC 23049 18:58:18.885993 tst mo_mt_call.py: using RAC 99 18:58:19.011371 tst mo_mt_call.py: using CellId 23049 18:58:19.133726 tst mo_mt_call.py: using BVCI 23050 18:58:19.244807 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:19.255708 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:19.266306 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:19.276800 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:19.287384 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:19.298537 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:58:19.415984 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:58:19.531760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:20.003796 run create_hlr_db(pid=3617): Launched 18:58:20.131504 bus /sierra_2: Setting Powered False 18:58:21.192106 run create_hlr_db(pid=3617): Terminated: ok {rc=0} 18:58:21.638292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Launched 18:58:21.964859 run osmo-hlr_10.42.42.2(pid=3620): Launched 18:58:22.088461 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:22.648911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Launched 18:58:22.973586 run osmo-stp_10.42.42.5(pid=3623): Launched 18:58:23.097092 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:23.685103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Launched 18:58:24.009853 run osmo-msc_10.42.42.6(pid=3626): Launched 18:58:24.190433 run osmo-stp_10.42.42.5(pid=3623): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] 18:58:24.327792 run osmo-stp_10.42.42.5(pid=3623): stdout: | (launched: 2022-12-09_18:58:22.914207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:24.465876 run osmo-stp_10.42.42.5(pid=3623): stderr: | [0;m[38;5;43m20221209185823104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185823104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185823105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185823105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185823105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185823105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185823106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:24.602373 run osmo-stp_10.42.42.5(pid=3623): stdout: | (launched: 2022-12-09_18:58:22.914207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:24.732220 run osmo-stp_10.42.42.5(pid=3623): stderr: | [0;m[38;5;43m20221209185823104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185823104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185823105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185823105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185823105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185823105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185823106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:24.887287 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3623): Process ended prematurely: osmo-stp_10.42.42.5(pid=3623) [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 18:58:24.896698 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:58:24.924851 run osmo-hlr_10.42.42.2(pid=3620): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3620)] 18:58:24.974532 run osmo-hlr_10.42.42.2(pid=3620): stdout: | (launched: 2022-12-09_18:58:21.905692) 18:58:25.025825 run osmo-hlr_10.42.42.2(pid=3620): stderr: | [0;m[1;31m20221209185822103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185822103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185822103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185822104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185822104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185822104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185822115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185822124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185822124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185822124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:25.097316 run osmo-msc_10.42.42.6(pid=3626): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3626)] 18:58:25.147065 run osmo-msc_10.42.42.6(pid=3626): stdout: | (launched: 2022-12-09_18:58:23.950366) 18:58:25.198493 run osmo-msc_10.42.42.6(pid=3626): stderr: | [0;m[38;5;43m20221209185824270 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185824271 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4049508c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185824271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185824271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185824271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185824271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185824273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185824273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185824273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185824273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:25.250446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Terminating (SIGTERM) 18:58:25.291920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Terminating (SIGTERM) 18:58:25.333713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Terminating (SIGTERM) 18:58:25.375428 --- ParallelTerminationStrategy: PID 3619 died... 18:58:25.395097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Terminated: ok {rc=0} 18:58:25.441249 --- ParallelTerminationStrategy: PID 3622 died... 18:58:25.460337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Terminated: ok {rc=0} 18:58:25.506319 --- ParallelTerminationStrategy: PID 3625 died... 18:58:25.525694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Terminated: ok {rc=0} 18:58:25.613854 bus /sierra_3: Setting Powered False 18:58:26.713166 bus /sierra_3: Setting Powered False 18:58:27.829298 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 18:58:28.978866 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:28.990833 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:58:29.043056 tst mo_mt_call_osmux.py: using LAC 23050 18:58:29.170385 tst mo_mt_call_osmux.py: using RAC 100 18:58:29.298575 tst mo_mt_call_osmux.py: using CellId 23050 18:58:29.424508 tst mo_mt_call_osmux.py: using BVCI 23051 18:58:29.543132 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:29.554568 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:29.565669 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:29.577033 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:29.588416 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:58:29.599817 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:58:29.716515 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:58:29.832190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:30.302485 run create_hlr_db(pid=3628): Launched 18:58:30.428332 bus /sierra_2: Setting Powered False 18:58:31.499446 run create_hlr_db(pid=3628): Terminated: ok {rc=0} 18:58:32.015100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Launched 18:58:32.354169 run osmo-hlr_10.42.42.2(pid=3631): Launched 18:58:32.481554 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:33.043584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Launched 18:58:33.370425 run osmo-stp_10.42.42.5(pid=3634): Launched 18:58:33.494399 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:34.082931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Launched 18:58:34.409102 run osmo-msc_10.42.42.6(pid=3637): Launched 18:58:34.590567 run osmo-stp_10.42.42.5(pid=3634): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] 18:58:34.727991 run osmo-stp_10.42.42.5(pid=3634): stdout: | (launched: 2022-12-09_18:58:33.310980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:34.866594 run osmo-stp_10.42.42.5(pid=3634): stderr: | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185833504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:35.002941 run osmo-stp_10.42.42.5(pid=3634): stdout: | (launched: 2022-12-09_18:58:33.310980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:35.133130 run osmo-stp_10.42.42.5(pid=3634): stderr: | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185833503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185833504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185833504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:35.289710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3634): Process ended prematurely: osmo-stp_10.42.42.5(pid=3634) [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 18:58:35.299122 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:58:35.327266 run osmo-hlr_10.42.42.2(pid=3631): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3631)] 18:58:35.377855 run osmo-hlr_10.42.42.2(pid=3631): stdout: | (launched: 2022-12-09_18:58:32.294883) 18:58:35.429551 run osmo-hlr_10.42.42.2(pid=3631): stderr: | [0;m[1;31m20221209185832490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185832490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185832491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185832491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185832491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185832491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185832503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185832511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185832511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185832511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:35.501502 run osmo-msc_10.42.42.6(pid=3637): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3637)] 18:58:35.551545 run osmo-msc_10.42.42.6(pid=3637): stdout: | (launched: 2022-12-09_18:58:34.349953) 18:58:35.603218 run osmo-msc_10.42.42.6(pid=3637): stderr: | [0;m[38;5;43m20221209185834670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185834670 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb193142c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185834670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185834670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185834670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185834671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185834672 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185834673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185834673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185834673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:35.655128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Terminating (SIGTERM) 18:58:35.696874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Terminating (SIGTERM) 18:58:35.738674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Terminating (SIGTERM) 18:58:35.780652 --- ParallelTerminationStrategy: PID 3630 died... 18:58:35.800410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Terminated: ok {rc=0} 18:58:35.846703 --- ParallelTerminationStrategy: PID 3633 died... 18:58:35.866351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Terminated: ok {rc=0} 18:58:35.913183 --- ParallelTerminationStrategy: PID 3636 died... 18:58:35.932545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Terminated: ok {rc=0} 18:58:36.019321 bus /sierra_3: Setting Powered False 18:58:37.118368 bus /sierra_3: Setting Powered False 18:58:38.232874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:58:39.474716 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:58:39.480466 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:58:39.513239 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:58:39.539874 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:58:39.591486 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:58:39.624285 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:58:39.650375 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:58:40.200677 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:58:40.255907 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.267728 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:58:40.321748 tst mo_mt_call.py: using LAC 23051 18:58:40.449123 tst mo_mt_call.py: using RAC 101 18:58:40.578718 tst mo_mt_call.py: using CellId 23051 18:58:40.699948 tst mo_mt_call.py: using BVCI 23052 18:58:40.820198 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.832054 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.843721 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.856408 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.868732 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:40.880177 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:58:40.996764 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:58:41.113122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:41.586623 run create_hlr_db(pid=3642): Launched 18:58:41.711281 bus /sierra_2: Setting Powered False 18:58:42.771585 run create_hlr_db(pid=3642): Terminated: ok {rc=0} 18:58:43.217679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3644): Launched 18:58:43.545501 run osmo-hlr_10.42.42.2(pid=3645): Launched 18:58:43.672017 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:44.233494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3647): Launched 18:58:44.561020 run osmo-stp_10.42.42.5(pid=3648): Launched 18:58:44.686022 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:45.277615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3650): Launched 18:58:45.604526 run osmo-msc_10.42.42.6(pid=3651): Launched 18:58:45.787326 run osmo-stp_10.42.42.5(pid=3648): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3648)] 18:58:45.944498 run osmo-stp_10.42.42.5(pid=3648): stdout: | (launched: 2022-12-09_18:58:44.501477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:46.104852 run osmo-stp_10.42.42.5(pid=3648): stderr: | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185844694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:46.343887 run osmo-stp_10.42.42.5(pid=3648): stdout: | (launched: 2022-12-09_18:58:44.501477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:46.477267 run osmo-stp_10.42.42.5(pid=3648): stderr: | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185844693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185844694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185844694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:46.636218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3648): Process ended prematurely: osmo-stp_10.42.42.5(pid=3648) [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3648)] [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:58:46.646906 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:58:46.677871 run osmo-hlr_10.42.42.2(pid=3645): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3645)] 18:58:46.729811 run osmo-hlr_10.42.42.2(pid=3645): stdout: | (launched: 2022-12-09_18:58:43.486366) 18:58:46.783360 run osmo-hlr_10.42.42.2(pid=3645): stderr: | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185843685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185843697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185843705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185843706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185843706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:46.857531 run osmo-msc_10.42.42.6(pid=3651): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3651)] 18:58:46.909508 run osmo-msc_10.42.42.6(pid=3651): stdout: | (launched: 2022-12-09_18:58:45.544818) 18:58:46.963177 run osmo-msc_10.42.42.6(pid=3651): stderr: | [0;m[38;5;43m20221209185845954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185845954 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12b212dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185845954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185845954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185845955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185845955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185845957 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185845957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185845957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185845957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:47.017196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3644): Terminating (SIGTERM) 18:58:47.061040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3647): Terminating (SIGTERM) 18:58:47.104891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3650): Terminating (SIGTERM) 18:58:47.148821 --- ParallelTerminationStrategy: PID 3644 died... 18:58:47.169125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3644): Terminated: ok {rc=0} 18:58:47.218148 --- ParallelTerminationStrategy: PID 3647 died... 18:58:47.238733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3647): Terminated: ok {rc=0} 18:58:47.287491 --- ParallelTerminationStrategy: PID 3650 died... 18:58:47.306898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3650): Terminated: ok {rc=0} 18:58:47.395098 bus /sierra_3: Setting Powered False 18:58:48.493443 bus /sierra_3: Setting Powered False 18:58:49.608486 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:58:50.757219 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:50.769620 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:58:50.822890 tst mo_mt_call_osmux.py: using LAC 23052 18:58:50.951215 tst mo_mt_call_osmux.py: using RAC 102 18:58:51.077860 tst mo_mt_call_osmux.py: using CellId 23052 18:58:51.204767 tst mo_mt_call_osmux.py: using BVCI 23053 18:58:51.316137 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:51.327510 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:51.338599 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:51.349831 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:51.360872 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:58:51.372314 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:58:51.487419 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:58:51.611573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:52.117741 run create_hlr_db(pid=3653): Launched 18:58:52.243856 bus /sierra_2: Setting Powered False 18:58:53.308765 run create_hlr_db(pid=3653): Terminated: ok {rc=0} 18:58:53.745173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3655): Launched 18:58:54.049497 run osmo-hlr_10.42.42.2(pid=3656): Launched 18:58:54.165182 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:54.688819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3658): Launched 18:58:54.992239 run osmo-stp_10.42.42.5(pid=3659): Launched 18:58:55.107168 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:55.656623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3661): Launched 18:58:55.961146 run osmo-msc_10.42.42.6(pid=3662): Launched 18:58:56.130134 run osmo-stp_10.42.42.5(pid=3659): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3659)] 18:58:56.258802 run osmo-stp_10.42.42.5(pid=3659): stdout: | (launched: 2022-12-09_18:58:54.936610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:56.386567 run osmo-stp_10.42.42.5(pid=3659): stderr: | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185855106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:56.512421 run osmo-stp_10.42.42.5(pid=3659): stdout: | (launched: 2022-12-09_18:58:54.936610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:56.633228 run osmo-stp_10.42.42.5(pid=3659): stderr: | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185855106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185855106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185855107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:56.777625 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3659): Process ended prematurely: osmo-stp_10.42.42.5(pid=3659) [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3659)] [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:58:56.786556 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:58:56.812586 run osmo-hlr_10.42.42.2(pid=3656): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3656)] 18:58:56.859562 run osmo-hlr_10.42.42.2(pid=3656): stdout: | (launched: 2022-12-09_18:58:53.994391) 18:58:56.908555 run osmo-hlr_10.42.42.2(pid=3656): stderr: | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185854167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185854180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185854188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185854188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185854188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:56.975903 run osmo-msc_10.42.42.6(pid=3662): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3662)] 18:58:57.022760 run osmo-msc_10.42.42.6(pid=3662): stdout: | (launched: 2022-12-09_18:58:55.904337) 18:58:57.071204 run osmo-msc_10.42.42.6(pid=3662): stderr: | [0;m[38;5;43m20221209185856176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185856176 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc6e2e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185856176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185856176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185856176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185856177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185856178 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185856179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185856180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185856180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:57.119884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3655): Terminating (SIGTERM) 18:58:57.158802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3658): Terminating (SIGTERM) 18:58:57.197896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3661): Terminating (SIGTERM) 18:58:57.237078 --- ParallelTerminationStrategy: PID 3655 died... 18:58:57.255686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3655): Terminated: ok {rc=0} 18:58:57.298794 --- ParallelTerminationStrategy: PID 3658 died... 18:58:57.317146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3658): Terminated: ok {rc=0} 18:58:57.359993 --- ParallelTerminationStrategy: PID 3661 died... 18:58:57.378333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3661): Terminated: ok {rc=0} 18:58:57.463151 bus /sierra_3: Setting Powered False 18:58:58.561483 bus /sierra_3: Setting Powered False 18:58:59.674893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:trx-b200 --------------------------------------------------------------------- 18:59:00.939538 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:00.944436 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 18:59:00.992123 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:59:01.021388 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 18:59:01.107574 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 18:59:01.141496 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:59:01.168410 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 18:59:01.787541 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 18:59:01.796692 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:01.811748 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 18:59:01.881607 tst emergency_mo_mt_call.py: using LAC 23053 18:59:02.025846 tst emergency_mo_mt_call.py: using RAC 103 18:59:02.152558 tst emergency_mo_mt_call.py: using CellId 23053 18:59:02.275367 tst emergency_mo_mt_call.py: using BVCI 23054 18:59:02.386095 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:02.397280 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:02.408356 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:02.419276 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:02.430222 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:02.440870 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:02.555670 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:02.674198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:03.170523 run create_hlr_db(pid=3667): Launched 18:59:03.294099 bus /sierra_2: Setting Powered False 18:59:04.356653 run create_hlr_db(pid=3667): Terminated: ok {rc=0} 18:59:04.786439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3669): Launched 18:59:05.086966 run osmo-hlr_10.42.42.2(pid=3670): Launched 18:59:05.200561 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:05.731162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3672): Launched 18:59:06.028934 run osmo-stp_10.42.42.5(pid=3673): Launched 18:59:06.152553 tst emergency_mo_mt_call.py: using MSISDN 7331 18:59:06.305854 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:06.842241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3675): Launched 18:59:07.141468 run osmo-msc_10.42.42.6(pid=3676): Launched 18:59:07.307656 run osmo-stp_10.42.42.5(pid=3673): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3673)] 18:59:07.433631 run osmo-stp_10.42.42.5(pid=3673): stdout: | (launched: 2022-12-09_18:59:05.974151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:07.560700 run osmo-stp_10.42.42.5(pid=3673): stderr: | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185906143 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:07.684663 run osmo-stp_10.42.42.5(pid=3673): stdout: | (launched: 2022-12-09_18:59:05.974151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:07.803581 run osmo-stp_10.42.42.5(pid=3673): stderr: | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185906142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185906143 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185906143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:07.946204 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3673): Process ended prematurely: osmo-stp_10.42.42.5(pid=3673) [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3673)] [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 18:59:07.954325 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:59:07.979853 run osmo-hlr_10.42.42.2(pid=3670): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3670)] 18:59:08.027008 run osmo-hlr_10.42.42.2(pid=3670): stdout: | (launched: 2022-12-09_18:59:05.031634) 18:59:08.075810 run osmo-hlr_10.42.42.2(pid=3670): stderr: | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185905206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185905219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185905228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185905228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185905228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:08.144130 run osmo-msc_10.42.42.6(pid=3676): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3676)] 18:59:08.191322 run osmo-msc_10.42.42.6(pid=3676): stdout: | (launched: 2022-12-09_18:59:07.085708) 18:59:08.240450 run osmo-msc_10.42.42.6(pid=3676): stderr: | [0;m[38;5;43m20221209185907355 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185907355 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a43d95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185907356 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185907356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185907356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185907356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185907359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185907359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185907360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185907360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:08.289605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3669): Terminating (SIGTERM) 18:59:08.328625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3672): Terminating (SIGTERM) 18:59:08.367539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3675): Terminating (SIGTERM) 18:59:08.406638 --- ParallelTerminationStrategy: PID 3669 died... 18:59:08.425101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3669): Terminated: ok {rc=0} 18:59:08.468582 --- ParallelTerminationStrategy: PID 3672 died... 18:59:08.486915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3672): Terminated: ok {rc=0} 18:59:08.530140 --- ParallelTerminationStrategy: PID 3675 died... 18:59:08.548565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3675): Terminated: ok {rc=0} 18:59:08.633042 bus /sierra_3: Setting Powered False 18:59:09.727788 bus /sierra_3: Setting Powered False 18:59:10.840072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 18:59:11.927409 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:11.939239 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 18:59:11.989963 tst emergency_preemptive_call.py: using LAC 23054 18:59:12.114270 tst emergency_preemptive_call.py: using RAC 104 18:59:12.240877 tst emergency_preemptive_call.py: using CellId 23054 18:59:12.366192 tst emergency_preemptive_call.py: using BVCI 23055 18:59:12.482861 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:12.494014 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:12.504769 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:12.515853 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:12.527015 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:59:12.538163 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:12.656687 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:12.776172 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:12.893240 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:59:13.011138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:13.510545 run create_hlr_db(pid=3678): Launched 18:59:13.633331 bus /sierra_2: Setting Powered False 18:59:14.696935 run create_hlr_db(pid=3678): Terminated: ok {rc=0} 18:59:15.126157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Launched 18:59:15.425418 run osmo-hlr_10.42.42.2(pid=3681): Launched 18:59:15.539843 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:16.086290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Launched 18:59:16.493658 run osmo-stp_10.42.42.5(pid=3684): Launched 18:59:16.719240 tst emergency_preemptive_call.py: using MSISDN 7332 18:59:17.035526 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:17.648711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3686): Launched 18:59:17.969734 run osmo-msc_10.42.42.6(pid=3687): Launched 18:59:18.149286 run osmo-stp_10.42.42.5(pid=3684): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] 18:59:18.285286 run osmo-stp_10.42.42.5(pid=3684): stdout: | (launched: 2022-12-09_18:59:16.427646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:18.421423 run osmo-stp_10.42.42.5(pid=3684): stderr: | [0;m[38;5;43m20221209185916755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185916756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185916756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185916756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185916758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185916759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185916759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:18.556639 run osmo-stp_10.42.42.5(pid=3684): stdout: | (launched: 2022-12-09_18:59:16.427646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:18.685158 run osmo-stp_10.42.42.5(pid=3684): stderr: | [0;m[38;5;43m20221209185916755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185916756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185916756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185916756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185916758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185916759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185916759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:18.838664 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3684): Process ended prematurely: osmo-stp_10.42.42.5(pid=3684) [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py:32] 18:59:18.847561 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 18:59:18.875755 run osmo-hlr_10.42.42.2(pid=3681): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3681)] 18:59:18.926219 run osmo-hlr_10.42.42.2(pid=3681): stdout: | (launched: 2022-12-09_18:59:15.370644) 18:59:18.978271 run osmo-hlr_10.42.42.2(pid=3681): stderr: | [0;m[1;31m20221209185915544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185915544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185915544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185915545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185915545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185915545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185915557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185915566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185915566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185915566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:19.050620 run osmo-msc_10.42.42.6(pid=3687): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3687)] 18:59:19.100636 run osmo-msc_10.42.42.6(pid=3687): stdout: | (launched: 2022-12-09_18:59:17.910500) 18:59:19.152210 run osmo-msc_10.42.42.6(pid=3687): stderr: | [0;m[38;5;43m20221209185918231 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209185918231 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f92b4849c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209185918231 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209185918231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209185918231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209185918231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209185918233 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209185918234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209185918234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209185918234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:19.204249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Terminating (SIGTERM) 18:59:19.246173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Terminating (SIGTERM) 18:59:19.288617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3686): Terminating (SIGTERM) 18:59:19.330879 --- ParallelTerminationStrategy: PID 3680 died... 18:59:19.350765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Terminated: ok {rc=0} 18:59:19.397512 --- ParallelTerminationStrategy: PID 3683 died... 18:59:19.417089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Terminated: ok {rc=0} 18:59:19.463303 --- ParallelTerminationStrategy: PID 3686 died... 18:59:19.482881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3686): Terminated: ok {rc=0} 18:59:19.570677 bus /sierra_9: Setting Powered False 18:59:20.670502 bus /sierra_9: Setting Powered False 18:59:21.786778 bus /sierra_8: Setting Powered False 18:59:22.885465 bus /sierra_8: Setting Powered False 18:59:24.001871 bus /sierra_3: Setting Powered False 18:59:25.097832 bus /sierra_3: Setting Powered False 18:59:26.213871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-b200 --------------------------------------------------------------------- 18:59:27.494705 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:27.498842 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 18:59:27.531328 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 18:59:27.568770 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 18:59:27.653399 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 18:59:27.687417 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 18:59:27.726816 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 18:59:28.313677 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 18:59:28.364150 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.374633 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:59:28.422427 tst cs_paging_gprs_active.py: using LAC 23055 18:59:28.543686 tst cs_paging_gprs_active.py: using RAC 105 18:59:28.662870 tst cs_paging_gprs_active.py: using CellId 23055 18:59:28.790200 tst cs_paging_gprs_active.py: using BVCI 23056 18:59:28.911163 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.922418 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.933403 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.944300 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.955341 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.966267 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.977306 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.988150 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:28.999136 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:29.116529 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:29.231744 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:59:29.437184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:29.743524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Launched 18:59:30.007898 run iperf3-srv_10.42.42.10(pid=3693): Launched 18:59:30.121749 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:59:30.326750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:30.632743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Launched 18:59:30.913639 run iperf3-srv_10.42.42.10(pid=3695): Launched 18:59:31.038103 tst cs_paging_gprs_active.py:38: start network... 18:59:31.245521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:31.726669 run create_hlr_db(pid=3696): Launched 18:59:31.874509 bus /sierra_2: Setting Powered False 18:59:32.935361 run create_hlr_db(pid=3696): Terminated: ok {rc=0} 18:59:33.360723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Launched 18:59:33.665950 run osmo-hlr_10.42.42.2(pid=3699): Launched 18:59:33.782547 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:34.309796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Launched 18:59:34.615704 run osmo-stp_10.42.42.5(pid=3702): Launched 18:59:34.730754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:59:35.258029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Launched 18:59:35.374482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:59:35.633032 run patchelf(pid=3705): Launched 18:59:35.803313 run osmo-stp_10.42.42.5(pid=3702): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] 18:59:35.932479 run osmo-stp_10.42.42.5(pid=3702): stdout: | (launched: 2022-12-09_18:59:34.559692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:36.063322 run osmo-stp_10.42.42.5(pid=3702): stderr: | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185934730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:36.194866 run osmo-stp_10.42.42.5(pid=3702): stdout: | (launched: 2022-12-09_18:59:34.559692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:36.320089 run osmo-stp_10.42.42.5(pid=3702): stderr: | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185934729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185934730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185934730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:36.468826 run patchelf(pid=3705): Terminating (SIGINT) 18:59:36.639431 run patchelf(pid=3705): Terminated: ok {rc=0} 18:59:36.762290 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3702): Process ended prematurely: osmo-stp_10.42.42.5(pid=3702) [trial-2363↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] [trial-2363↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 18:59:36.771759 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 18:59:36.798558 run osmo-hlr_10.42.42.2(pid=3699): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3699)] 18:59:36.845494 run osmo-hlr_10.42.42.2(pid=3699): stdout: | (launched: 2022-12-09_18:59:33.609090) 18:59:36.894181 run osmo-hlr_10.42.42.2(pid=3699): stderr: | [0;m[1;31m20221209185933783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185933783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185933783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185933783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185933784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185933784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185933795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185933805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185933805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185933806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:36.943089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminating (SIGTERM) 18:59:36.982400 run iperf3-srv_10.42.42.10(pid=3693): Terminating (SIGTERM) 18:59:37.022058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminating (SIGTERM) 18:59:37.061616 run iperf3-srv_10.42.42.10(pid=3695): Terminating (SIGTERM) 18:59:37.101054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Terminating (SIGTERM) 18:59:37.140533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Terminating (SIGTERM) 18:59:37.179839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Terminating (SIGTERM) 18:59:37.219425 --- ParallelTerminationStrategy: PID 3692 died... 18:59:37.238303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminated: ok {rc=0} 18:59:37.281690 --- ParallelTerminationStrategy: PID 3693 died... 18:59:37.299882 run iperf3-srv_10.42.42.10(pid=3693): Terminated {rc=256} 18:59:37.343210 --- ParallelTerminationStrategy: PID 3694 died... 18:59:37.361478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminated: ok {rc=0} 18:59:37.404817 --- ParallelTerminationStrategy: PID 3695 died... 18:59:37.423543 run iperf3-srv_10.42.42.10(pid=3695): Terminated {rc=256} 18:59:37.466773 --- ParallelTerminationStrategy: PID 3698 died... 18:59:37.485090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Terminated: ok {rc=0} 18:59:37.528336 --- ParallelTerminationStrategy: PID 3701 died... 18:59:37.546581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Terminated: ok {rc=0} 18:59:37.589936 --- ParallelTerminationStrategy: PID 3704 died... 18:59:37.608235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Terminated: ok {rc=0} 18:59:37.691647 bus /gobi_0: Setting Powered False 18:59:38.790967 bus /gobi_0: Setting Powered False 18:59:39.905788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200 iperf3.py ---------------------------------------------- 18:59:41.051856 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.063024 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:59:41.113851 tst iperf3.py: using LAC 23056 18:59:41.234247 tst iperf3.py: using RAC 106 18:59:41.354687 tst iperf3.py: using CellId 23056 18:59:41.475764 tst iperf3.py: using BVCI 23057 18:59:41.587292 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.597889 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.608156 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.618538 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.628642 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.638838 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.649117 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.659301 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:41.669702 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:41.784195 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:59:42.006763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:42.334934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3706): Launched 18:59:42.619993 run iperf3-srv_10.42.42.10(pid=3707): Launched 18:59:42.742749 tst iperf3.py:8: start network... 18:59:42.964827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:43.472337 run create_hlr_db(pid=3708): Launched 18:59:43.596740 bus /gobi_6: Setting Powered False 18:59:44.661185 run create_hlr_db(pid=3708): Terminated: ok {rc=0} 18:59:45.113490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3710): Launched 18:59:45.440411 run osmo-hlr_10.42.42.2(pid=3711): Launched 18:59:45.564282 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:46.146242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3713): Launched 18:59:46.493679 run osmo-stp_10.42.42.5(pid=3714): Launched 18:59:46.817290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:59:47.489218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3716): Launched 18:59:47.605391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:59:47.862997 run patchelf(pid=3717): Launched 18:59:48.032173 run osmo-stp_10.42.42.5(pid=3714): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3714)] 18:59:48.161185 run osmo-stp_10.42.42.5(pid=3714): stdout: | (launched: 2022-12-09_18:59:46.427559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:48.291478 run osmo-stp_10.42.42.5(pid=3714): stderr: | [0;m[38;5;43m20221209185946690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185946691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185946693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185946695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185946697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185946698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185946698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:48.422105 run osmo-stp_10.42.42.5(pid=3714): stdout: | (launched: 2022-12-09_18:59:46.427559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:48.546760 run osmo-stp_10.42.42.5(pid=3714): stderr: | [0;m[38;5;43m20221209185946690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185946691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185946693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185946695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185946697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185946698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185946698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:48.694313 run patchelf(pid=3717): Terminating (SIGINT) 18:59:48.864170 run patchelf(pid=3717): Terminated: ok {rc=0} 18:59:48.987043 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3714): Process ended prematurely: osmo-stp_10.42.42.5(pid=3714) [trial-2363↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3714)] [trial-2363↪gprs:trx-b200↪iperf3.py:8] 18:59:48.996313 tst iperf3.py:8: Test FAILED (8.0 sec) 18:59:49.022977 run osmo-hlr_10.42.42.2(pid=3711): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3711)] 18:59:49.069506 run osmo-hlr_10.42.42.2(pid=3711): stdout: | (launched: 2022-12-09_18:59:45.380581) 18:59:49.117955 run osmo-hlr_10.42.42.2(pid=3711): stderr: | [0;m[1;31m20221209185945578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185945578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185945579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185945579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185945579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185945579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185945590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185945599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185945599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185945599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:49.166443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3706): Terminating (SIGTERM) 18:59:49.205478 run iperf3-srv_10.42.42.10(pid=3707): Terminating (SIGTERM) 18:59:49.244428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3710): Terminating (SIGTERM) 18:59:49.283241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3713): Terminating (SIGTERM) 18:59:49.321973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3716): Terminating (SIGTERM) 18:59:49.360893 --- ParallelTerminationStrategy: PID 3706 died... 18:59:49.379566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3706): Terminated: ok {rc=0} 18:59:49.422727 --- ParallelTerminationStrategy: PID 3707 died... 18:59:49.440891 run iperf3-srv_10.42.42.10(pid=3707): Terminated {rc=256} 18:59:49.484176 --- ParallelTerminationStrategy: PID 3710 died... 18:59:49.502522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3710): Terminated: ok {rc=0} 18:59:49.545709 --- ParallelTerminationStrategy: PID 3713 died... 18:59:49.563863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3713): Terminated: ok {rc=0} 18:59:49.606971 --- ParallelTerminationStrategy: PID 3716 died... 18:59:49.625321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3716): Terminated: ok {rc=0} 18:59:49.711161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 18:59:50.858320 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:50.869464 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:59:50.920910 tst iperf3m4.py: using LAC 23057 18:59:51.039390 tst iperf3m4.py: using RAC 107 18:59:51.156536 tst iperf3m4.py: using CellId 23057 18:59:51.277163 tst iperf3m4.py: using BVCI 23058 18:59:51.388365 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.398969 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.409381 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.419640 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.429899 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.440063 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.450522 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.460688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:59:51.471069 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:51.589162 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:51.711553 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:51.828936 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:59:51.946781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:59:52.152127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:52.458428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3718): Launched 18:59:52.725713 run iperf3-srv_10.42.42.10(pid=3719): Launched 18:59:52.839317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:59:53.043120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:53.350262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3720): Launched 18:59:53.614890 run iperf3-srv_10.42.42.10(pid=3721): Launched 18:59:53.728240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:59:53.932775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:54.237964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3722): Launched 18:59:54.502333 run iperf3-srv_10.42.42.10(pid=3723): Launched 18:59:54.617620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:59:54.821254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:59:55.126733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3724): Launched 18:59:55.391067 run iperf3-srv_10.42.42.10(pid=3725): Launched 18:59:55.504490 tst iperf3m4.py:8: start network... 18:59:55.708234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:56.179919 run create_hlr_db(pid=3726): Launched 18:59:56.303813 bus /gobi_6: Setting Powered False 18:59:57.363930 run create_hlr_db(pid=3726): Terminated: ok {rc=0} 18:59:57.809911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3728): Launched 18:59:58.136575 run osmo-hlr_10.42.42.2(pid=3729): Launched 18:59:58.259989 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:58.827360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3731): Launched 18:59:59.153023 run osmo-stp_10.42.42.5(pid=3732): Launched 18:59:59.278412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:59:59.841356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3734): Launched 18:59:59.966028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:00:00.242155 run patchelf(pid=3735): Launched 19:00:00.425210 run osmo-stp_10.42.42.5(pid=3732): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3732)] 19:00:00.564539 run osmo-stp_10.42.42.5(pid=3732): stdout: | (launched: 2022-12-09_18:59:59.093697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:00.705184 run osmo-stp_10.42.42.5(pid=3732): stderr: | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185959281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:00.850700 run osmo-stp_10.42.42.5(pid=3732): stdout: | (launched: 2022-12-09_18:59:59.093697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:00.986083 run osmo-stp_10.42.42.5(pid=3732): stderr: | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209185959281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209185959281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209185959282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:01.140801 run patchelf(pid=3735): Terminating (SIGINT) 19:00:01.335998 run patchelf(pid=3735): Terminated: ok {rc=0} 19:00:01.466061 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3732): Process ended prematurely: osmo-stp_10.42.42.5(pid=3732) [trial-2363↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3732)] [trial-2363↪gprs:trx-b200↪iperf3m4.py:8] 19:00:01.477802 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:00:01.508558 run osmo-hlr_10.42.42.2(pid=3729): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3729)] 19:00:01.559445 run osmo-hlr_10.42.42.2(pid=3729): stdout: | (launched: 2022-12-09_18:59:58.076917) 19:00:01.613155 run osmo-hlr_10.42.42.2(pid=3729): stderr: | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209185958273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209185958286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209185958294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209185958294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209185958294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:01.666051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3718): Terminating (SIGTERM) 19:00:01.709233 run iperf3-srv_10.42.42.10(pid=3719): Terminating (SIGTERM) 19:00:01.751687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3720): Terminating (SIGTERM) 19:00:01.795366 run iperf3-srv_10.42.42.10(pid=3721): Terminating (SIGTERM) 19:00:01.839485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3722): Terminating (SIGTERM) 19:00:01.881801 run iperf3-srv_10.42.42.10(pid=3723): Terminating (SIGTERM) 19:00:01.924155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3724): Terminating (SIGTERM) 19:00:01.966734 run iperf3-srv_10.42.42.10(pid=3725): Terminating (SIGTERM) 19:00:02.009915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3728): Terminating (SIGTERM) 19:00:02.052781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3731): Terminating (SIGTERM) 19:00:02.097474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3734): Terminating (SIGTERM) 19:00:02.142426 --- ParallelTerminationStrategy: PID 3718 died... 19:00:02.162422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3718): Terminated: ok {rc=0} 19:00:02.212342 --- ParallelTerminationStrategy: PID 3719 died... 19:00:02.231930 run iperf3-srv_10.42.42.10(pid=3719): Terminated {rc=256} 19:00:02.278999 --- ParallelTerminationStrategy: PID 3720 died... 19:00:02.299010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3720): Terminated: ok {rc=0} 19:00:02.344113 --- ParallelTerminationStrategy: PID 3721 died... 19:00:02.362633 run iperf3-srv_10.42.42.10(pid=3721): Terminated {rc=256} 19:00:02.408010 --- ParallelTerminationStrategy: PID 3722 died... 19:00:02.426678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3722): Terminated: ok {rc=0} 19:00:02.471683 --- ParallelTerminationStrategy: PID 3723 died... 19:00:02.490490 run iperf3-srv_10.42.42.10(pid=3723): Terminated {rc=256} 19:00:02.535374 --- ParallelTerminationStrategy: PID 3724 died... 19:00:02.553960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3724): Terminated: ok {rc=0} 19:00:02.598764 --- ParallelTerminationStrategy: PID 3725 died... 19:00:02.617265 run iperf3-srv_10.42.42.10(pid=3725): Terminated {rc=256} 19:00:02.661941 --- ParallelTerminationStrategy: PID 3728 died... 19:00:02.680700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3728): Terminated: ok {rc=0} 19:00:02.725699 --- ParallelTerminationStrategy: PID 3731 died... 19:00:02.744315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3731): Terminated: ok {rc=0} 19:00:02.789650 --- ParallelTerminationStrategy: PID 3734 died... 19:00:02.808267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3734): Terminated: ok {rc=0} 19:00:02.895221 bus /gobi_4: Setting Powered False 19:00:03.994532 bus /gobi_4: Setting Powered False 19:00:05.108497 bus /gobi_1: Setting Powered False 19:00:06.205988 bus /gobi_1: Setting Powered False 19:00:07.319615 bus /gobi_0: Setting Powered False 19:00:08.419112 bus /gobi_0: Setting Powered False 19:00:09.531247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200 ping.py ---------------------------------------------- 19:00:10.631845 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:10.643660 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:00:10.692745 tst ping.py: using LAC 23058 19:00:10.819436 tst ping.py: using RAC 108 19:00:10.944736 tst ping.py: using CellId 23058 19:00:11.071471 tst ping.py: using BVCI 23059 19:00:11.189152 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.200371 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.211323 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.222556 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.233617 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.244568 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.255734 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:11.267103 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:00:11.385666 tst ping.py:19: start network... 19:00:11.603991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:12.104819 run create_hlr_db(pid=3739): Launched 19:00:12.227530 bus /gobi_6: Setting Powered False 19:00:13.292549 run create_hlr_db(pid=3739): Terminated: ok {rc=0} 19:00:13.724033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3741): Launched 19:00:14.026747 run osmo-hlr_10.42.42.2(pid=3742): Launched 19:00:14.143893 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:14.664451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3744): Launched 19:00:14.966140 run osmo-stp_10.42.42.5(pid=3745): Launched 19:00:15.081218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:00:15.601858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3747): Launched 19:00:15.716000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:00:15.978423 run patchelf(pid=3748): Launched 19:00:16.192155 run osmo-stp_10.42.42.5(pid=3745): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3745)] 19:00:16.335941 run osmo-stp_10.42.42.5(pid=3745): stdout: | (launched: 2022-12-09_19:00:14.910303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:16.480108 run osmo-stp_10.42.42.5(pid=3745): stderr: | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190015082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:16.626876 run osmo-stp_10.42.42.5(pid=3745): stdout: | (launched: 2022-12-09_19:00:14.910303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:16.764197 run osmo-stp_10.42.42.5(pid=3745): stderr: | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190015082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190015082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190015083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:16.928260 run patchelf(pid=3748): Terminating (SIGINT) 19:00:17.114949 run patchelf(pid=3748): Terminated: ok {rc=0} 19:00:17.249193 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3745): Process ended prematurely: osmo-stp_10.42.42.5(pid=3745) [trial-2363↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3745)] [trial-2363↪gprs:trx-b200↪ping.py:22] 19:00:17.259750 tst ping.py:22: Test FAILED (6.6 sec) 19:00:17.290843 run osmo-hlr_10.42.42.2(pid=3742): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3742)] 19:00:17.342378 run osmo-hlr_10.42.42.2(pid=3742): stdout: | (launched: 2022-12-09_19:00:13.970776) 19:00:17.395033 run osmo-hlr_10.42.42.2(pid=3742): stderr: | [0;m[1;31m20221209190014145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190014145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190014146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190014146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190014146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190014146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190014157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190014166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190014166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190014166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:17.448241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3741): Terminating (SIGTERM) 19:00:17.491176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3744): Terminating (SIGTERM) 19:00:17.534284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3747): Terminating (SIGTERM) 19:00:17.577190 --- ParallelTerminationStrategy: PID 3741 died... 19:00:17.597425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3741): Terminated: ok {rc=0} 19:00:17.645601 --- ParallelTerminationStrategy: PID 3744 died... 19:00:17.665423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3744): Terminated: ok {rc=0} 19:00:17.713404 --- ParallelTerminationStrategy: PID 3747 died... 19:00:17.733049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3747): Terminated: ok {rc=0} 19:00:17.822644 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 19:00:18.910547 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:18.922813 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:00:18.974640 tst ping_idle_ping.py: using LAC 23059 19:00:19.101858 tst ping_idle_ping.py: using RAC 109 19:00:19.230270 tst ping_idle_ping.py: using CellId 23059 19:00:19.357292 tst ping_idle_ping.py: using BVCI 23060 19:00:19.476528 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.487713 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.498669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.509867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.520826 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.532057 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.543272 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:19.554481 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:00:19.672400 tst ping_idle_ping.py:24: start network... 19:00:19.890933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:20.395728 run create_hlr_db(pid=3749): Launched 19:00:20.519275 bus /gobi_6: Setting Powered False 19:00:21.583550 run create_hlr_db(pid=3749): Terminated: ok {rc=0} 19:00:22.017072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3751): Launched 19:00:22.320796 run osmo-hlr_10.42.42.2(pid=3752): Launched 19:00:22.437121 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:22.963149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3754): Launched 19:00:23.265260 run osmo-stp_10.42.42.5(pid=3755): Launched 19:00:23.380222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:00:23.902801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3757): Launched 19:00:24.018373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:00:24.275457 run patchelf(pid=3758): Launched 19:00:24.443380 run osmo-stp_10.42.42.5(pid=3755): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3755)] 19:00:24.571306 run osmo-stp_10.42.42.5(pid=3755): stdout: | (launched: 2022-12-09_19:00:23.209269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:24.700888 run osmo-stp_10.42.42.5(pid=3755): stderr: | [0;m[38;5;43m20221209190023380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190023381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190023381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190023381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:24.830655 run osmo-stp_10.42.42.5(pid=3755): stdout: | (launched: 2022-12-09_19:00:23.209269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:24.954525 run osmo-stp_10.42.42.5(pid=3755): stderr: | [0;m[38;5;43m20221209190023380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190023381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190023381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190023381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190023382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:25.101422 run patchelf(pid=3758): Terminating (SIGINT) 19:00:25.270906 run patchelf(pid=3758): Terminated: ok {rc=0} 19:00:25.393345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3755): Process ended prematurely: osmo-stp_10.42.42.5(pid=3755) [trial-2363↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3755)] [trial-2363↪gprs:trx-b200↪ping_idle_ping.py:27] 19:00:25.402239 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:00:25.428717 run osmo-hlr_10.42.42.2(pid=3752): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3752)] 19:00:25.476326 run osmo-hlr_10.42.42.2(pid=3752): stdout: | (launched: 2022-12-09_19:00:22.264726) 19:00:25.525777 run osmo-hlr_10.42.42.2(pid=3752): stderr: | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190022442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190022455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190022464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190022464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190022464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:25.575313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3751): Terminating (SIGTERM) 19:00:25.614909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3754): Terminating (SIGTERM) 19:00:25.654661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3757): Terminating (SIGTERM) 19:00:25.694829 --- ParallelTerminationStrategy: PID 3751 died... 19:00:25.713922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3751): Terminated: ok {rc=0} 19:00:25.757952 --- ParallelTerminationStrategy: PID 3754 died... 19:00:25.776628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3754): Terminated: ok {rc=0} 19:00:25.820366 --- ParallelTerminationStrategy: PID 3757 died... 19:00:25.839019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3757): Terminated: ok {rc=0} 19:00:25.926167 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 19:00:27.234825 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:27.240370 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:00:27.273122 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:00:27.310679 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:00:27.398612 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:00:27.434911 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:00:27.474353 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:00:28.058955 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:00:28.109238 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.119845 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:00:28.169416 tst cs_paging_gprs_active.py: using LAC 23060 19:00:28.289298 tst cs_paging_gprs_active.py: using RAC 110 19:00:28.419158 tst cs_paging_gprs_active.py: using CellId 23060 19:00:28.547337 tst cs_paging_gprs_active.py: using BVCI 23061 19:00:28.667647 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.679210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.690512 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.702119 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.713272 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.724361 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.736096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.747617 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:28.759220 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:28.881283 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:28.999343 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:00:29.224122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:29.556377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Launched 19:00:29.842870 run iperf3-srv_10.42.42.10(pid=3764): Launched 19:00:29.967594 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:00:30.190803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:30.522064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Launched 19:00:30.807740 run iperf3-srv_10.42.42.10(pid=3766): Launched 19:00:30.934459 tst cs_paging_gprs_active.py:38: start network... 19:00:31.162396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:31.760757 run create_hlr_db(pid=3767): Launched 19:00:31.924071 bus /gobi_6: Setting Powered False 19:00:32.988752 run create_hlr_db(pid=3767): Terminated: ok {rc=0} 19:00:33.429262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Launched 19:00:33.738195 run osmo-hlr_10.42.42.2(pid=3770): Launched 19:00:33.854385 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:34.388927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Launched 19:00:34.696418 run osmo-stp_10.42.42.5(pid=3773): Launched 19:00:34.813518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:00:35.345646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Launched 19:00:35.462636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:00:35.722753 run patchelf(pid=3776): Launched 19:00:35.893555 run osmo-stp_10.42.42.5(pid=3773): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] 19:00:36.023546 run osmo-stp_10.42.42.5(pid=3773): stdout: | (launched: 2022-12-09_19:00:34.639902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:36.154958 run osmo-stp_10.42.42.5(pid=3773): stderr: | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190034814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:36.287577 run osmo-stp_10.42.42.5(pid=3773): stdout: | (launched: 2022-12-09_19:00:34.639902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:36.413306 run osmo-stp_10.42.42.5(pid=3773): stderr: | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190034813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190034814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190034814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:36.562390 run patchelf(pid=3776): Terminating (SIGINT) 19:00:36.733898 run patchelf(pid=3776): Terminated: ok {rc=0} 19:00:36.857620 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3773): Process ended prematurely: osmo-stp_10.42.42.5(pid=3773) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:00:36.867231 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:00:36.894110 run osmo-hlr_10.42.42.2(pid=3770): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3770)] 19:00:36.941585 run osmo-hlr_10.42.42.2(pid=3770): stdout: | (launched: 2022-12-09_19:00:33.681762) 19:00:36.990305 run osmo-hlr_10.42.42.2(pid=3770): stderr: | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190033858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190033871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190033880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190033880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190033880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:37.039334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminating (SIGTERM) 19:00:37.078559 run iperf3-srv_10.42.42.10(pid=3764): Terminating (SIGTERM) 19:00:37.117657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminating (SIGTERM) 19:00:37.156747 run iperf3-srv_10.42.42.10(pid=3766): Terminating (SIGTERM) 19:00:37.195730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Terminating (SIGTERM) 19:00:37.234809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Terminating (SIGTERM) 19:00:37.274128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Terminating (SIGTERM) 19:00:37.313483 --- ParallelTerminationStrategy: PID 3763 died... 19:00:37.332212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminated: ok {rc=0} 19:00:37.375476 --- ParallelTerminationStrategy: PID 3764 died... 19:00:37.393678 run iperf3-srv_10.42.42.10(pid=3764): Terminated {rc=256} 19:00:37.436579 --- ParallelTerminationStrategy: PID 3765 died... 19:00:37.454797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminated: ok {rc=0} 19:00:37.498124 --- ParallelTerminationStrategy: PID 3766 died... 19:00:37.516362 run iperf3-srv_10.42.42.10(pid=3766): Terminated {rc=256} 19:00:37.559365 --- ParallelTerminationStrategy: PID 3769 died... 19:00:37.577673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Terminated: ok {rc=0} 19:00:37.620872 --- ParallelTerminationStrategy: PID 3772 died... 19:00:37.639692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Terminated: ok {rc=0} 19:00:37.683016 --- ParallelTerminationStrategy: PID 3775 died... 19:00:37.701131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Terminated: ok {rc=0} 19:00:37.785794 bus /gobi_0: Setting Powered False 19:00:38.884199 bus /gobi_0: Setting Powered False 19:00:39.998961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:00:41.144825 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.156222 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:00:41.207997 tst iperf3.py: using LAC 23061 19:00:41.327515 tst iperf3.py: using RAC 111 19:00:41.449112 tst iperf3.py: using CellId 23061 19:00:41.569081 tst iperf3.py: using BVCI 23062 19:00:41.680101 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.691028 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.701661 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.712156 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.722646 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.733096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.743754 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.754257 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:41.764864 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:41.883088 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:00:42.105783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:42.437083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3777): Launched 19:00:42.723241 run iperf3-srv_10.42.42.10(pid=3778): Launched 19:00:42.847912 tst iperf3.py:8: start network... 19:00:43.070885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:43.582101 run create_hlr_db(pid=3779): Launched 19:00:43.708772 bus /gobi_6: Setting Powered False 19:00:44.773595 run create_hlr_db(pid=3779): Terminated: ok {rc=0} 19:00:45.213497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Launched 19:00:45.520355 run osmo-hlr_10.42.42.2(pid=3782): Launched 19:00:45.640020 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:46.193517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Launched 19:00:46.517910 run osmo-stp_10.42.42.5(pid=3785): Launched 19:00:46.750633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:00:47.347136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Launched 19:00:47.464080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:00:47.723642 run patchelf(pid=3788): Launched 19:00:47.893450 run osmo-stp_10.42.42.5(pid=3785): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] 19:00:48.023364 run osmo-stp_10.42.42.5(pid=3785): stdout: | (launched: 2022-12-09_19:00:46.460583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:48.154939 run osmo-stp_10.42.42.5(pid=3785): stderr: | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190046819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:48.286873 run osmo-stp_10.42.42.5(pid=3785): stdout: | (launched: 2022-12-09_19:00:46.460583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:48.413384 run osmo-stp_10.42.42.5(pid=3785): stderr: | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190046818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190046819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190046827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:48.562690 run patchelf(pid=3788): Terminating (SIGINT) 19:00:48.733704 run patchelf(pid=3788): Terminated: ok {rc=0} 19:00:48.857588 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3785): Process ended prematurely: osmo-stp_10.42.42.5(pid=3785) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 19:00:48.867167 tst iperf3.py:8: Test FAILED (7.8 sec) 19:00:48.894064 run osmo-hlr_10.42.42.2(pid=3782): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3782)] 19:00:48.941156 run osmo-hlr_10.42.42.2(pid=3782): stdout: | (launched: 2022-12-09_19:00:45.463974) 19:00:48.989933 run osmo-hlr_10.42.42.2(pid=3782): stderr: | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190045643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190045655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190045663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190045664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190045664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:49.039196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3777): Terminating (SIGTERM) 19:00:49.078392 run iperf3-srv_10.42.42.10(pid=3778): Terminating (SIGTERM) 19:00:49.117471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Terminating (SIGTERM) 19:00:49.156654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Terminating (SIGTERM) 19:00:49.195646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Terminating (SIGTERM) 19:00:49.234877 --- ParallelTerminationStrategy: PID 3777 died... 19:00:49.253559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3777): Terminated: ok {rc=0} 19:00:49.296831 --- ParallelTerminationStrategy: PID 3778 died... 19:00:49.315215 run iperf3-srv_10.42.42.10(pid=3778): Terminated {rc=256} 19:00:49.358498 --- ParallelTerminationStrategy: PID 3781 died... 19:00:49.376702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Terminated: ok {rc=0} 19:00:49.420152 --- ParallelTerminationStrategy: PID 3784 died... 19:00:49.438430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Terminated: ok {rc=0} 19:00:49.481553 --- ParallelTerminationStrategy: PID 3787 died... 19:00:49.499995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Terminated: ok {rc=0} 19:00:49.585944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:00:50.732578 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:50.744035 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:00:50.793388 tst iperf3m4.py: using LAC 23062 19:00:50.915719 tst iperf3m4.py: using RAC 112 19:00:51.037699 tst iperf3m4.py: using CellId 23062 19:00:51.159330 tst iperf3m4.py: using BVCI 23063 19:00:51.271799 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.282725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.293443 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.303955 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.314496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.324930 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.335608 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.346159 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:00:51.356765 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:51.476042 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:51.600137 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:51.719865 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:00:51.841322 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:00:52.065343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:52.397310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3789): Launched 19:00:52.684729 run iperf3-srv_10.42.42.10(pid=3790): Launched 19:00:52.807725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:00:53.029992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:53.361003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3791): Launched 19:00:53.646369 run iperf3-srv_10.42.42.10(pid=3792): Launched 19:00:53.770865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:00:53.993164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:54.324050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Launched 19:00:54.610826 run iperf3-srv_10.42.42.10(pid=3794): Launched 19:00:54.733898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:00:54.956251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:55.287030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3795): Launched 19:00:55.574679 run iperf3-srv_10.42.42.10(pid=3796): Launched 19:00:55.699401 tst iperf3m4.py:8: start network... 19:00:55.921619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:56.432441 run create_hlr_db(pid=3797): Launched 19:00:56.559217 bus /gobi_6: Setting Powered False 19:00:57.623699 run create_hlr_db(pid=3797): Terminated: ok {rc=0} 19:00:58.082415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Launched 19:00:58.413273 run osmo-hlr_10.42.42.2(pid=3800): Launched 19:00:58.539299 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:59.106188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Launched 19:00:59.434787 run osmo-stp_10.42.42.5(pid=3803): Launched 19:00:59.561316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:00.128643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3805): Launched 19:01:00.255867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:00.535323 run patchelf(pid=3806): Launched 19:01:00.719512 run osmo-stp_10.42.42.5(pid=3803): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] 19:01:00.871917 run osmo-stp_10.42.42.5(pid=3803): stdout: | (launched: 2022-12-09_19:00:59.374915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:01.015739 run osmo-stp_10.42.42.5(pid=3803): stderr: | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190059568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:01.160404 run osmo-stp_10.42.42.5(pid=3803): stdout: | (launched: 2022-12-09_19:00:59.374915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:01.299219 run osmo-stp_10.42.42.5(pid=3803): stderr: | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190059567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190059568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190059568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:01.464469 run patchelf(pid=3806): Terminating (SIGINT) 19:01:01.652791 run patchelf(pid=3806): Terminated: ok {rc=0} 19:01:01.789496 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3803): Process ended prematurely: osmo-stp_10.42.42.5(pid=3803) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 19:01:01.800837 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:01:01.833387 run osmo-hlr_10.42.42.2(pid=3800): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3800)] 19:01:01.886820 run osmo-hlr_10.42.42.2(pid=3800): stdout: | (launched: 2022-12-09_19:00:58.352535) 19:01:01.940822 run osmo-hlr_10.42.42.2(pid=3800): stderr: | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190058552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190058564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190058573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190058573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190058573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:01.995500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3789): Terminating (SIGTERM) 19:01:02.039779 run iperf3-srv_10.42.42.10(pid=3790): Terminating (SIGTERM) 19:01:02.083767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3791): Terminating (SIGTERM) 19:01:02.127811 run iperf3-srv_10.42.42.10(pid=3792): Terminating (SIGTERM) 19:01:02.171723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Terminating (SIGTERM) 19:01:02.214298 run iperf3-srv_10.42.42.10(pid=3794): Terminating (SIGTERM) 19:01:02.256080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3795): Terminating (SIGTERM) 19:01:02.297867 run iperf3-srv_10.42.42.10(pid=3796): Terminating (SIGTERM) 19:01:02.339914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Terminating (SIGTERM) 19:01:02.381927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Terminating (SIGTERM) 19:01:02.423621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3805): Terminating (SIGTERM) 19:01:02.465762 --- ParallelTerminationStrategy: PID 3789 died... 19:01:02.485661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3789): Terminated: ok {rc=0} 19:01:02.532210 --- ParallelTerminationStrategy: PID 3790 died... 19:01:02.551586 run iperf3-srv_10.42.42.10(pid=3790): Terminated {rc=256} 19:01:02.597658 --- ParallelTerminationStrategy: PID 3791 died... 19:01:02.617039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3791): Terminated: ok {rc=0} 19:01:02.663199 --- ParallelTerminationStrategy: PID 3792 died... 19:01:02.682571 run iperf3-srv_10.42.42.10(pid=3792): Terminated {rc=256} 19:01:02.728558 --- ParallelTerminationStrategy: PID 3793 died... 19:01:02.747865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Terminated: ok {rc=0} 19:01:02.793922 --- ParallelTerminationStrategy: PID 3794 died... 19:01:02.813243 run iperf3-srv_10.42.42.10(pid=3794): Terminated {rc=256} 19:01:02.859612 --- ParallelTerminationStrategy: PID 3795 died... 19:01:02.878833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3795): Terminated: ok {rc=0} 19:01:02.924755 --- ParallelTerminationStrategy: PID 3796 died... 19:01:02.944205 run iperf3-srv_10.42.42.10(pid=3796): Terminated {rc=256} 19:01:02.990178 --- ParallelTerminationStrategy: PID 3799 died... 19:01:03.009455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Terminated: ok {rc=0} 19:01:03.055859 --- ParallelTerminationStrategy: PID 3802 died... 19:01:03.075252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Terminated: ok {rc=0} 19:01:03.121476 --- ParallelTerminationStrategy: PID 3805 died... 19:01:03.141093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3805): Terminated: ok {rc=0} 19:01:03.228708 bus /gobi_4: Setting Powered False 19:01:04.326855 bus /gobi_4: Setting Powered False 19:01:05.442690 bus /gobi_1: Setting Powered False 19:01:06.541431 bus /gobi_1: Setting Powered False 19:01:07.656940 bus /gobi_0: Setting Powered False 19:01:08.755844 bus /gobi_0: Setting Powered False 19:01:09.871248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 19:01:10.974186 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:10.985713 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:01:11.036248 tst ping.py: using LAC 23063 19:01:11.160802 tst ping.py: using RAC 113 19:01:11.280027 tst ping.py: using CellId 23063 19:01:11.406312 tst ping.py: using BVCI 23064 19:01:11.523406 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.534798 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.545959 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.557264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.568673 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.579904 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.591397 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:11.602838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:01:11.718125 tst ping.py:19: start network... 19:01:11.936283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:12.438068 run create_hlr_db(pid=3807): Launched 19:01:12.562909 bus /gobi_6: Setting Powered False 19:01:13.626705 run create_hlr_db(pid=3807): Terminated: ok {rc=0} 19:01:14.060068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3809): Launched 19:01:14.364007 run osmo-hlr_10.42.42.2(pid=3810): Launched 19:01:14.479578 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:15.006309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3812): Launched 19:01:15.334855 run osmo-stp_10.42.42.5(pid=3813): Launched 19:01:15.460657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:16.029701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3815): Launched 19:01:16.192742 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:16.525604 run patchelf(pid=3816): Launched 19:01:16.722224 run osmo-stp_10.42.42.5(pid=3813): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3813)] 19:01:16.862773 run osmo-stp_10.42.42.5(pid=3813): stdout: | (launched: 2022-12-09_19:01:15.275300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:17.013999 run osmo-stp_10.42.42.5(pid=3813): stderr: | [0;m[38;5;43m20221209190115468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190115468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190115469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190115469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:17.173548 run osmo-stp_10.42.42.5(pid=3813): stdout: | (launched: 2022-12-09_19:01:15.275300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:17.310451 run osmo-stp_10.42.42.5(pid=3813): stderr: | [0;m[38;5;43m20221209190115468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190115468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190115469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190115469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190115470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:17.468302 run patchelf(pid=3816): Terminating (SIGINT) 19:01:17.649424 run patchelf(pid=3816): Terminated: ok {rc=0} 19:01:17.779857 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3813): Process ended prematurely: osmo-stp_10.42.42.5(pid=3813) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3813)] [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 19:01:17.789757 tst ping.py:22: Test FAILED (6.8 sec) 19:01:17.818870 run osmo-hlr_10.42.42.2(pid=3810): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3810)] 19:01:17.869668 run osmo-hlr_10.42.42.2(pid=3810): stdout: | (launched: 2022-12-09_19:01:14.307546) 19:01:17.922014 run osmo-hlr_10.42.42.2(pid=3810): stderr: | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190114486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190114498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190114509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190114509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190114509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:17.974964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3809): Terminating (SIGTERM) 19:01:18.017636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3812): Terminating (SIGTERM) 19:01:18.060051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3815): Terminating (SIGTERM) 19:01:18.102826 --- ParallelTerminationStrategy: PID 3809 died... 19:01:18.123024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3809): Terminated: ok {rc=0} 19:01:18.170336 --- ParallelTerminationStrategy: PID 3812 died... 19:01:18.190051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3812): Terminated: ok {rc=0} 19:01:18.237261 --- ParallelTerminationStrategy: PID 3815 died... 19:01:18.256815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3815): Terminated: ok {rc=0} 19:01:18.346531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:01:19.433904 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:19.445877 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:01:19.498399 tst ping_idle_ping.py: using LAC 23064 19:01:19.626395 tst ping_idle_ping.py: using RAC 114 19:01:19.757301 tst ping_idle_ping.py: using CellId 23064 19:01:19.883312 tst ping_idle_ping.py: using BVCI 23065 19:01:20.000711 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.012168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.023313 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.034707 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.045969 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.057108 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.068602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:20.080039 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:01:20.197361 tst ping_idle_ping.py:24: start network... 19:01:20.401041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:20.873766 run create_hlr_db(pid=3817): Launched 19:01:20.998171 bus /gobi_6: Setting Powered False 19:01:22.058462 run create_hlr_db(pid=3817): Terminated: ok {rc=0} 19:01:22.501719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3819): Launched 19:01:22.826284 run osmo-hlr_10.42.42.2(pid=3820): Launched 19:01:22.951324 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:23.513359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3822): Launched 19:01:23.838724 run osmo-stp_10.42.42.5(pid=3823): Launched 19:01:23.963814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:24.525243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3825): Launched 19:01:24.649827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:24.923584 run patchelf(pid=3826): Launched 19:01:25.103448 run osmo-stp_10.42.42.5(pid=3823): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3823)] 19:01:25.240918 run osmo-stp_10.42.42.5(pid=3823): stdout: | (launched: 2022-12-09_19:01:23.779246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:25.380056 run osmo-stp_10.42.42.5(pid=3823): stderr: | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190123971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:25.519172 run osmo-stp_10.42.42.5(pid=3823): stdout: | (launched: 2022-12-09_19:01:23.779246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:25.652377 run osmo-stp_10.42.42.5(pid=3823): stderr: | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190123970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190123971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190123971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:25.810231 run patchelf(pid=3826): Terminating (SIGINT) 19:01:25.991469 run patchelf(pid=3826): Terminated: ok {rc=0} 19:01:26.121890 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3823): Process ended prematurely: osmo-stp_10.42.42.5(pid=3823) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3823)] [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 19:01:26.131698 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:01:26.160401 run osmo-hlr_10.42.42.2(pid=3820): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3820)] 19:01:26.210575 run osmo-hlr_10.42.42.2(pid=3820): stdout: | (launched: 2022-12-09_19:01:22.766990) 19:01:26.262419 run osmo-hlr_10.42.42.2(pid=3820): stderr: | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190122965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190122978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190122988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190122988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190122989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:26.314739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3819): Terminating (SIGTERM) 19:01:26.356766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3822): Terminating (SIGTERM) 19:01:26.398886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3825): Terminating (SIGTERM) 19:01:26.441208 --- ParallelTerminationStrategy: PID 3819 died... 19:01:26.461122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3819): Terminated: ok {rc=0} 19:01:26.508217 --- ParallelTerminationStrategy: PID 3822 died... 19:01:26.527816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3822): Terminated: ok {rc=0} 19:01:26.574268 --- ParallelTerminationStrategy: PID 3825 died... 19:01:26.593811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3825): Terminated: ok {rc=0} 19:01:26.681411 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:01:27.994729 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:28.001165 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:01:28.035735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:01:28.075130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:01:28.162625 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:01:28.196398 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:01:28.235766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:01:28.830895 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:01:28.884002 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:28.895219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:01:28.965353 tst cs_paging_gprs_active.py: using LAC 23065 19:01:29.095235 tst cs_paging_gprs_active.py: using RAC 115 19:01:29.224919 tst cs_paging_gprs_active.py: using CellId 23065 19:01:29.354985 tst cs_paging_gprs_active.py: using BVCI 23066 19:01:29.475933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.487166 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.498350 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.510392 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.521855 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.533356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.544663 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.555982 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:29.567805 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:29.686656 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:29.803189 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:01:30.027814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:30.359627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3832): Launched 19:01:30.646737 run iperf3-srv_10.42.42.10(pid=3833): Launched 19:01:30.770748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:01:31.046417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:31.371607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3834): Launched 19:01:31.669664 run iperf3-srv_10.42.42.10(pid=3835): Launched 19:01:31.805148 tst cs_paging_gprs_active.py:38: start network... 19:01:32.020001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:32.501981 run create_hlr_db(pid=3836): Launched 19:01:32.630762 bus /gobi_6: Setting Powered False 19:01:33.695712 run create_hlr_db(pid=3836): Terminated: ok {rc=0} 19:01:34.135354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Launched 19:01:34.443017 run osmo-hlr_10.42.42.2(pid=3839): Launched 19:01:34.561293 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:35.093236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Launched 19:01:35.401583 run osmo-stp_10.42.42.5(pid=3842): Launched 19:01:35.518418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:36.053617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3844): Launched 19:01:36.170734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:36.431091 run patchelf(pid=3845): Launched 19:01:36.601551 run osmo-stp_10.42.42.5(pid=3842): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] 19:01:36.732744 run osmo-stp_10.42.42.5(pid=3842): stdout: | (launched: 2022-12-09_19:01:35.344794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:36.864689 run osmo-stp_10.42.42.5(pid=3842): stderr: | [0;m[38;5;43m20221209190135516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190135517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190135517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190135517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:36.996645 run osmo-stp_10.42.42.5(pid=3842): stdout: | (launched: 2022-12-09_19:01:35.344794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:37.122906 run osmo-stp_10.42.42.5(pid=3842): stderr: | [0;m[38;5;43m20221209190135516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190135517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190135517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190135517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190135518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:37.272906 run patchelf(pid=3845): Terminating (SIGINT) 19:01:37.445434 run patchelf(pid=3845): Terminated: ok {rc=0} 19:01:37.569801 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3842): Process ended prematurely: osmo-stp_10.42.42.5(pid=3842) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:01:37.579344 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:01:37.606345 run osmo-hlr_10.42.42.2(pid=3839): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3839)] 19:01:37.653704 run osmo-hlr_10.42.42.2(pid=3839): stdout: | (launched: 2022-12-09_19:01:34.386827) 19:01:37.702777 run osmo-hlr_10.42.42.2(pid=3839): stderr: | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190134562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190134574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190134582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190134582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190134582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:37.752042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3832): Terminating (SIGTERM) 19:01:37.791303 run iperf3-srv_10.42.42.10(pid=3833): Terminating (SIGTERM) 19:01:37.830598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3834): Terminating (SIGTERM) 19:01:37.869852 run iperf3-srv_10.42.42.10(pid=3835): Terminating (SIGTERM) 19:01:37.909047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Terminating (SIGTERM) 19:01:37.948135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Terminating (SIGTERM) 19:01:37.987205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3844): Terminating (SIGTERM) 19:01:38.026791 --- ParallelTerminationStrategy: PID 3832 died... 19:01:38.045787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3832): Terminated: ok {rc=0} 19:01:38.089369 --- ParallelTerminationStrategy: PID 3833 died... 19:01:38.107813 run iperf3-srv_10.42.42.10(pid=3833): Terminated {rc=256} 19:01:38.151162 --- ParallelTerminationStrategy: PID 3834 died... 19:01:38.169562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3834): Terminated: ok {rc=0} 19:01:38.212876 --- ParallelTerminationStrategy: PID 3835 died... 19:01:38.231606 run iperf3-srv_10.42.42.10(pid=3835): Terminated {rc=256} 19:01:38.274805 --- ParallelTerminationStrategy: PID 3838 died... 19:01:38.293126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Terminated: ok {rc=0} 19:01:38.336919 --- ParallelTerminationStrategy: PID 3841 died... 19:01:38.355516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Terminated: ok {rc=0} 19:01:38.398737 --- ParallelTerminationStrategy: PID 3844 died... 19:01:38.417211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3844): Terminated: ok {rc=0} 19:01:38.503039 bus /gobi_0: Setting Powered False 19:01:39.603733 bus /gobi_0: Setting Powered False 19:01:40.718006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:01:41.868261 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:41.880203 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:01:41.954812 tst iperf3.py: using LAC 23066 19:01:42.083908 tst iperf3.py: using RAC 116 19:01:42.211761 tst iperf3.py: using CellId 23066 19:01:42.339213 tst iperf3.py: using BVCI 23067 19:01:42.458931 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.470442 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.481579 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.492821 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.504142 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.515548 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.526978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.538559 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:42.550370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:42.667107 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:01:42.876396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:43.186690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3846): Launched 19:01:43.455472 run iperf3-srv_10.42.42.10(pid=3847): Launched 19:01:43.570887 tst iperf3.py:8: start network... 19:01:43.778604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:44.255173 run create_hlr_db(pid=3848): Launched 19:01:44.381409 bus /gobi_6: Setting Powered False 19:01:45.446265 run create_hlr_db(pid=3848): Terminated: ok {rc=0} 19:01:45.917675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3850): Launched 19:01:46.317615 run osmo-hlr_10.42.42.2(pid=3851): Launched 19:01:46.461543 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:47.209794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3853): Launched 19:01:47.534909 run osmo-stp_10.42.42.5(pid=3854): Launched 19:01:47.652163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:48.185309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3856): Launched 19:01:48.302145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:48.561874 run patchelf(pid=3857): Launched 19:01:48.732208 run osmo-stp_10.42.42.5(pid=3854): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3854)] 19:01:48.862459 run osmo-stp_10.42.42.5(pid=3854): stdout: | (launched: 2022-12-09_19:01:47.478373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:48.993777 run osmo-stp_10.42.42.5(pid=3854): stderr: | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190147651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:49.125352 run osmo-stp_10.42.42.5(pid=3854): stdout: | (launched: 2022-12-09_19:01:47.478373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:49.250789 run osmo-stp_10.42.42.5(pid=3854): stderr: | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190147650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190147651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190147651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:49.399608 run patchelf(pid=3857): Terminating (SIGINT) 19:01:49.570781 run patchelf(pid=3857): Terminated: ok {rc=0} 19:01:49.694590 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3854): Process ended prematurely: osmo-stp_10.42.42.5(pid=3854) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3854)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 19:01:49.704127 tst iperf3.py:8: Test FAILED (7.9 sec) 19:01:49.731386 run osmo-hlr_10.42.42.2(pid=3851): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3851)] 19:01:49.778866 run osmo-hlr_10.42.42.2(pid=3851): stdout: | (launched: 2022-12-09_19:01:46.259133) 19:01:49.828027 run osmo-hlr_10.42.42.2(pid=3851): stderr: | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190146651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190146676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190146695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190146695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190146695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:49.877413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3846): Terminating (SIGTERM) 19:01:49.916793 run iperf3-srv_10.42.42.10(pid=3847): Terminating (SIGTERM) 19:01:49.955972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3850): Terminating (SIGTERM) 19:01:49.995203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3853): Terminating (SIGTERM) 19:01:50.034656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3856): Terminating (SIGTERM) 19:01:50.074370 --- ParallelTerminationStrategy: PID 3846 died... 19:01:50.093454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3846): Terminated: ok {rc=0} 19:01:50.137198 --- ParallelTerminationStrategy: PID 3847 died... 19:01:50.155524 run iperf3-srv_10.42.42.10(pid=3847): Terminated {rc=256} 19:01:50.199076 --- ParallelTerminationStrategy: PID 3850 died... 19:01:50.217524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3850): Terminated: ok {rc=0} 19:01:50.261090 --- ParallelTerminationStrategy: PID 3853 died... 19:01:50.279454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3853): Terminated: ok {rc=0} 19:01:50.323155 --- ParallelTerminationStrategy: PID 3856 died... 19:01:50.341822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3856): Terminated: ok {rc=0} 19:01:50.427673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:01:51.576773 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:51.588336 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:01:51.657882 tst iperf3m4.py: using LAC 23067 19:01:51.781770 tst iperf3m4.py: using RAC 117 19:01:51.911064 tst iperf3m4.py: using CellId 23067 19:01:52.039268 tst iperf3m4.py: using BVCI 23068 19:01:52.158899 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.170511 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.181748 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.193762 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.205548 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.217815 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.230517 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.241569 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:01:52.253599 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:52.373583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:52.496315 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:52.615908 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:01:52.735242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:01:52.944644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:53.254978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3858): Launched 19:01:53.524231 run iperf3-srv_10.42.42.10(pid=3859): Launched 19:01:53.639661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:01:53.846550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:54.155336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3860): Launched 19:01:54.423414 run iperf3-srv_10.42.42.10(pid=3861): Launched 19:01:54.538921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:01:54.746304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:55.057153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3862): Launched 19:01:55.324670 run iperf3-srv_10.42.42.10(pid=3863): Launched 19:01:55.439612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:01:55.645842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:55.954892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3864): Launched 19:01:56.224776 run iperf3-srv_10.42.42.10(pid=3865): Launched 19:01:56.340000 tst iperf3m4.py:8: start network... 19:01:56.546623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:57.024529 run create_hlr_db(pid=3866): Launched 19:01:57.151085 bus /gobi_6: Setting Powered False 19:01:58.212462 run create_hlr_db(pid=3866): Terminated: ok {rc=0} 19:01:58.662164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Launched 19:01:58.992750 run osmo-hlr_10.42.42.2(pid=3869): Launched 19:01:59.118385 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:59.690173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Launched 19:02:00.020749 run osmo-stp_10.42.42.5(pid=3872): Launched 19:02:00.157620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:00.725256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Launched 19:02:00.854308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:01.121958 run patchelf(pid=3875): Launched 19:02:01.321395 run osmo-stp_10.42.42.5(pid=3872): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] 19:02:01.464831 run osmo-stp_10.42.42.5(pid=3872): stdout: | (launched: 2022-12-09_19:01:59.959690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:01.609253 run osmo-stp_10.42.42.5(pid=3872): stderr: | [0;m[38;5;43m20221209190200159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190200160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190200160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190200160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:01.754006 run osmo-stp_10.42.42.5(pid=3872): stdout: | (launched: 2022-12-09_19:01:59.959690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:01.892897 run osmo-stp_10.42.42.5(pid=3872): stderr: | [0;m[38;5;43m20221209190200159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190200160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190200160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190200160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190200161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:02.056874 run patchelf(pid=3875): Terminating (SIGINT) 19:02:02.244769 run patchelf(pid=3875): Terminated: ok {rc=0} 19:02:02.378484 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3872): Process ended prematurely: osmo-stp_10.42.42.5(pid=3872) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:02:02.388903 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:02:02.418663 run osmo-hlr_10.42.42.2(pid=3869): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3869)] 19:02:02.469472 run osmo-hlr_10.42.42.2(pid=3869): stdout: | (launched: 2022-12-09_19:01:58.932616) 19:02:02.521943 run osmo-hlr_10.42.42.2(pid=3869): stderr: | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190159130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190159145 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190159153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190159154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190159154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:02.575783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3858): Terminating (SIGTERM) 19:02:02.618761 run iperf3-srv_10.42.42.10(pid=3859): Terminating (SIGTERM) 19:02:02.660720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3860): Terminating (SIGTERM) 19:02:02.703453 run iperf3-srv_10.42.42.10(pid=3861): Terminating (SIGTERM) 19:02:02.745887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3862): Terminating (SIGTERM) 19:02:02.788398 run iperf3-srv_10.42.42.10(pid=3863): Terminating (SIGTERM) 19:02:02.831163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3864): Terminating (SIGTERM) 19:02:02.873767 run iperf3-srv_10.42.42.10(pid=3865): Terminating (SIGTERM) 19:02:02.916294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Terminating (SIGTERM) 19:02:02.958793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Terminating (SIGTERM) 19:02:03.001166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Terminating (SIGTERM) 19:02:03.043922 --- ParallelTerminationStrategy: PID 3858 died... 19:02:03.064069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3858): Terminated: ok {rc=0} 19:02:03.111425 --- ParallelTerminationStrategy: PID 3859 died... 19:02:03.131016 run iperf3-srv_10.42.42.10(pid=3859): Terminated {rc=256} 19:02:03.177892 --- ParallelTerminationStrategy: PID 3860 died... 19:02:03.197552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3860): Terminated: ok {rc=0} 19:02:03.244343 --- ParallelTerminationStrategy: PID 3861 died... 19:02:03.263994 run iperf3-srv_10.42.42.10(pid=3861): Terminated {rc=256} 19:02:03.310556 --- ParallelTerminationStrategy: PID 3862 died... 19:02:03.330211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3862): Terminated: ok {rc=0} 19:02:03.377307 --- ParallelTerminationStrategy: PID 3863 died... 19:02:03.397000 run iperf3-srv_10.42.42.10(pid=3863): Terminated {rc=256} 19:02:03.443596 --- ParallelTerminationStrategy: PID 3864 died... 19:02:03.463272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3864): Terminated: ok {rc=0} 19:02:03.510011 --- ParallelTerminationStrategy: PID 3865 died... 19:02:03.529645 run iperf3-srv_10.42.42.10(pid=3865): Terminated {rc=256} 19:02:03.576047 --- ParallelTerminationStrategy: PID 3868 died... 19:02:03.595574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Terminated: ok {rc=0} 19:02:03.642304 --- ParallelTerminationStrategy: PID 3871 died... 19:02:03.661788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Terminated: ok {rc=0} 19:02:03.708226 --- ParallelTerminationStrategy: PID 3874 died... 19:02:03.727798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Terminated: ok {rc=0} 19:02:03.816106 bus /gobi_4: Setting Powered False 19:02:04.915280 bus /gobi_4: Setting Powered False 19:02:06.031023 bus /gobi_1: Setting Powered False 19:02:07.125791 bus /gobi_1: Setting Powered False 19:02:08.240676 bus /gobi_0: Setting Powered False 19:02:09.339530 bus /gobi_0: Setting Powered False 19:02:10.455250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:02:11.557851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:11.569445 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:02:11.637909 tst ping.py: using LAC 23068 19:02:11.758562 tst ping.py: using RAC 118 19:02:11.880653 tst ping.py: using CellId 23068 19:02:12.003080 tst ping.py: using BVCI 23069 19:02:12.114519 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.125545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.136240 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.146925 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.157476 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.168039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.178852 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:12.189449 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:02:12.307569 tst ping.py:19: start network... 19:02:12.527501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:13.031567 run create_hlr_db(pid=3876): Launched 19:02:13.155539 bus /gobi_6: Setting Powered False 19:02:14.219507 run create_hlr_db(pid=3876): Terminated: ok {rc=0} 19:02:14.653840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Launched 19:02:14.957040 run osmo-hlr_10.42.42.2(pid=3879): Launched 19:02:15.072379 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:15.596536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Launched 19:02:15.929662 run osmo-stp_10.42.42.5(pid=3882): Launched 19:02:16.070434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:16.902096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3884): Launched 19:02:17.021117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:17.284797 run patchelf(pid=3885): Launched 19:02:17.477657 run osmo-stp_10.42.42.5(pid=3882): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] 19:02:17.615000 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-09_19:02:15.849269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:17.753537 run osmo-stp_10.42.42.5(pid=3882): stderr: | [0;m[38;5;43m20221209190216280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190216281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190216283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190216285 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190216287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190216288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190216289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:17.892272 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-09_19:02:15.849269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:18.025436 run osmo-stp_10.42.42.5(pid=3882): stderr: | [0;m[38;5;43m20221209190216280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190216281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190216283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190216285 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190216287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190216288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190216289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:18.183343 run patchelf(pid=3885): Terminating (SIGINT) 19:02:18.364516 run patchelf(pid=3885): Terminated: ok {rc=0} 19:02:18.495102 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 19:02:18.504778 tst ping.py:22: Test FAILED (6.9 sec) 19:02:18.534215 run osmo-hlr_10.42.42.2(pid=3879): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3879)] 19:02:18.585231 run osmo-hlr_10.42.42.2(pid=3879): stdout: | (launched: 2022-12-09_19:02:14.901184) 19:02:18.637614 run osmo-hlr_10.42.42.2(pid=3879): stderr: | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190215079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190215140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190215149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190215149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190215149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:18.690333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminating (SIGTERM) 19:02:18.732831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminating (SIGTERM) 19:02:18.775158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3884): Terminating (SIGTERM) 19:02:18.818027 --- ParallelTerminationStrategy: PID 3878 died... 19:02:18.838247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminated: ok {rc=0} 19:02:18.885380 --- ParallelTerminationStrategy: PID 3881 died... 19:02:18.905620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminated: ok {rc=0} 19:02:18.952400 --- ParallelTerminationStrategy: PID 3884 died... 19:02:18.972111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3884): Terminated: ok {rc=0} 19:02:19.060539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:02:20.149645 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.162228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:02:20.234909 tst ping_idle_ping.py: using LAC 23069 19:02:20.364787 tst ping_idle_ping.py: using RAC 119 19:02:20.492863 tst ping_idle_ping.py: using CellId 23069 19:02:20.620845 tst ping_idle_ping.py: using BVCI 23070 19:02:20.731900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.742928 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.753879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.764543 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.775357 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.786237 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.797186 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:20.807754 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:02:20.925375 tst ping_idle_ping.py:24: start network... 19:02:21.130824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:21.610490 run create_hlr_db(pid=3886): Launched 19:02:21.736116 bus /gobi_6: Setting Powered False 19:02:22.796921 run create_hlr_db(pid=3886): Terminated: ok {rc=0} 19:02:23.240515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Launched 19:02:23.566224 run osmo-hlr_10.42.42.2(pid=3889): Launched 19:02:23.689798 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:24.250037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Launched 19:02:24.576873 run osmo-stp_10.42.42.5(pid=3892): Launched 19:02:24.701422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:25.262713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3894): Launched 19:02:25.388073 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:25.662333 run patchelf(pid=3895): Launched 19:02:25.842181 run osmo-stp_10.42.42.5(pid=3892): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] 19:02:25.979280 run osmo-stp_10.42.42.5(pid=3892): stdout: | (launched: 2022-12-09_19:02:24.517105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:26.118349 run osmo-stp_10.42.42.5(pid=3892): stderr: | [0;m[38;5;43m20221209190224711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190224711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190224712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190224712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:26.256833 run osmo-stp_10.42.42.5(pid=3892): stdout: | (launched: 2022-12-09_19:02:24.517105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:26.390161 run osmo-stp_10.42.42.5(pid=3892): stderr: | [0;m[38;5;43m20221209190224711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190224711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190224712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190224712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190224713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:26.547833 run patchelf(pid=3895): Terminating (SIGINT) 19:02:26.728446 run patchelf(pid=3895): Terminated: ok {rc=0} 19:02:26.859052 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3892): Process ended prematurely: osmo-stp_10.42.42.5(pid=3892) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:02:26.868677 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:02:26.897301 run osmo-hlr_10.42.42.2(pid=3889): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3889)] 19:02:26.947299 run osmo-hlr_10.42.42.2(pid=3889): stdout: | (launched: 2022-12-09_19:02:23.506501) 19:02:26.999170 run osmo-hlr_10.42.42.2(pid=3889): stderr: | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190223706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190223718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190223727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190223727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190223727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:27.051088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Terminating (SIGTERM) 19:02:27.092643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Terminating (SIGTERM) 19:02:27.134342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3894): Terminating (SIGTERM) 19:02:27.175821 --- ParallelTerminationStrategy: PID 3888 died... 19:02:27.195643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Terminated: ok {rc=0} 19:02:27.241740 --- ParallelTerminationStrategy: PID 3891 died... 19:02:27.261206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Terminated: ok {rc=0} 19:02:27.306993 --- ParallelTerminationStrategy: PID 3894 died... 19:02:27.326153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3894): Terminated: ok {rc=0} 19:02:27.414039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:02:28.717554 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:28.724815 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:02:28.757768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:02:28.795534 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:02:28.880688 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:02:28.913672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:02:28.951464 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:02:29.545645 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:02:29.595108 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:29.605998 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:02:29.679772 tst cs_paging_gprs_active.py: using LAC 23070 19:02:29.800916 tst cs_paging_gprs_active.py: using RAC 120 19:02:29.920145 tst cs_paging_gprs_active.py: using CellId 23070 19:02:30.039493 tst cs_paging_gprs_active.py: using BVCI 23071 19:02:30.153319 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.164035 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.174609 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.185161 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.195579 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.206194 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.216763 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.227224 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:30.237883 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:30.356871 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:30.474947 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:02:30.683358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:31.024818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3900): Launched 19:02:31.307946 run iperf3-srv_10.42.42.10(pid=3901): Launched 19:02:31.448467 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:02:31.680568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:32.021695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3902): Launched 19:02:32.306788 run iperf3-srv_10.42.42.10(pid=3903): Launched 19:02:32.424431 tst cs_paging_gprs_active.py:38: start network... 19:02:32.631898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:33.110249 run create_hlr_db(pid=3904): Launched 19:02:33.237900 bus /gobi_6: Setting Powered False 19:02:34.298315 run create_hlr_db(pid=3904): Terminated: ok {rc=0} 19:02:34.749030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3906): Launched 19:02:35.079374 run osmo-hlr_10.42.42.2(pid=3907): Launched 19:02:35.207089 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:35.776428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3909): Launched 19:02:36.094845 run osmo-stp_10.42.42.5(pid=3912): Launched 19:02:36.211579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:36.743197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3914): Launched 19:02:36.861121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:37.122184 run patchelf(pid=3915): Launched 19:02:37.293662 run osmo-stp_10.42.42.5(pid=3912): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3912)] 19:02:37.424270 run osmo-stp_10.42.42.5(pid=3912): stdout: | (launched: 2022-12-09_19:02:36.038485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:37.556168 run osmo-stp_10.42.42.5(pid=3912): stderr: | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190236208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:37.688071 run osmo-stp_10.42.42.5(pid=3912): stdout: | (launched: 2022-12-09_19:02:36.038485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:37.814398 run osmo-stp_10.42.42.5(pid=3912): stderr: | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190236207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190236208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190236208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:37.964009 run patchelf(pid=3915): Terminating (SIGINT) 19:02:38.136660 run patchelf(pid=3915): Terminated: ok {rc=0} 19:02:38.261190 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3912): Process ended prematurely: osmo-stp_10.42.42.5(pid=3912) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3912)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:02:38.270668 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:02:38.297625 run osmo-hlr_10.42.42.2(pid=3907): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3907)] 19:02:38.344825 run osmo-hlr_10.42.42.2(pid=3907): stdout: | (launched: 2022-12-09_19:02:35.019427) 19:02:38.393784 run osmo-hlr_10.42.42.2(pid=3907): stderr: | [0;m[1;31m20221209190235220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190235221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190235221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190235221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190235221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190235221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190235233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190235243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190235243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190235243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:38.442980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3900): Terminating (SIGTERM) 19:02:38.482549 run iperf3-srv_10.42.42.10(pid=3901): Terminating (SIGTERM) 19:02:38.521852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3902): Terminating (SIGTERM) 19:02:38.561196 run iperf3-srv_10.42.42.10(pid=3903): Terminating (SIGTERM) 19:02:38.600354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3906): Terminating (SIGTERM) 19:02:38.639547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3909): Terminating (SIGTERM) 19:02:38.678778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3914): Terminating (SIGTERM) 19:02:38.718224 --- ParallelTerminationStrategy: PID 3900 died... 19:02:38.736903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3900): Terminated: ok {rc=0} 19:02:38.780566 --- ParallelTerminationStrategy: PID 3901 died... 19:02:38.798858 run iperf3-srv_10.42.42.10(pid=3901): Terminated {rc=256} 19:02:38.842039 --- ParallelTerminationStrategy: PID 3902 died... 19:02:38.860515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3902): Terminated: ok {rc=0} 19:02:38.903763 --- ParallelTerminationStrategy: PID 3903 died... 19:02:38.921975 run iperf3-srv_10.42.42.10(pid=3903): Terminated {rc=256} 19:02:38.965137 --- ParallelTerminationStrategy: PID 3906 died... 19:02:38.983456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3906): Terminated: ok {rc=0} 19:02:39.026845 --- ParallelTerminationStrategy: PID 3909 died... 19:02:39.045215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3909): Terminated: ok {rc=0} 19:02:39.088408 --- ParallelTerminationStrategy: PID 3914 died... 19:02:39.106834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3914): Terminated: ok {rc=0} 19:02:39.191839 bus /gobi_0: Setting Powered False 19:02:40.291744 bus /gobi_0: Setting Powered False 19:02:41.406154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:02:42.556555 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:42.568758 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:02:42.643167 tst iperf3.py: using LAC 23071 19:02:42.771731 tst iperf3.py: using RAC 121 19:02:42.900127 tst iperf3.py: using CellId 23071 19:02:43.028509 tst iperf3.py: using BVCI 23072 19:02:43.149931 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.161160 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.172261 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.183666 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.194924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.206253 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.217884 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.229392 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:43.241419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:43.359674 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:02:43.568098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:43.878583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3916): Launched 19:02:44.148071 run iperf3-srv_10.42.42.10(pid=3917): Launched 19:02:44.263158 tst iperf3.py:8: start network... 19:02:44.470079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:44.947210 run create_hlr_db(pid=3918): Launched 19:02:45.073183 bus /gobi_6: Setting Powered False 19:02:46.136160 run create_hlr_db(pid=3918): Terminated: ok {rc=0} 19:02:46.592258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Launched 19:02:46.919144 run osmo-hlr_10.42.42.2(pid=3921): Launched 19:02:47.173581 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:47.740318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Launched 19:02:48.069973 run osmo-stp_10.42.42.5(pid=3924): Launched 19:02:48.196722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:48.763986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3926): Launched 19:02:48.890576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:49.168033 run patchelf(pid=3927): Launched 19:02:49.353030 run osmo-stp_10.42.42.5(pid=3924): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] 19:02:49.492018 run osmo-stp_10.42.42.5(pid=3924): stdout: | (launched: 2022-12-09_19:02:48.010010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:49.632070 run osmo-stp_10.42.42.5(pid=3924): stderr: | [0;m[38;5;43m20221209190248201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190248202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190248202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190248202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:49.772164 run osmo-stp_10.42.42.5(pid=3924): stdout: | (launched: 2022-12-09_19:02:48.010010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:49.906534 run osmo-stp_10.42.42.5(pid=3924): stderr: | [0;m[38;5;43m20221209190248201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190248202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190248202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190248202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190248203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:50.065948 run patchelf(pid=3927): Terminating (SIGINT) 19:02:50.249250 run patchelf(pid=3927): Terminated: ok {rc=0} 19:02:50.381955 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3924): Process ended prematurely: osmo-stp_10.42.42.5(pid=3924) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 19:02:50.392127 tst iperf3.py:8: Test FAILED (7.9 sec) 19:02:50.421245 run osmo-hlr_10.42.42.2(pid=3921): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3921)] 19:02:50.471284 run osmo-hlr_10.42.42.2(pid=3921): stdout: | (launched: 2022-12-09_19:02:46.859608) 19:02:50.523013 run osmo-hlr_10.42.42.2(pid=3921): stderr: | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190247132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190247147 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190247160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190247160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190247160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:50.574947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3916): Terminating (SIGTERM) 19:02:50.617120 run iperf3-srv_10.42.42.10(pid=3917): Terminating (SIGTERM) 19:02:50.658749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Terminating (SIGTERM) 19:02:50.700374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Terminating (SIGTERM) 19:02:50.742383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3926): Terminating (SIGTERM) 19:02:50.784329 --- ParallelTerminationStrategy: PID 3916 died... 19:02:50.804123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3916): Terminated: ok {rc=0} 19:02:50.850318 --- ParallelTerminationStrategy: PID 3917 died... 19:02:50.869595 run iperf3-srv_10.42.42.10(pid=3917): Terminated {rc=256} 19:02:50.915492 --- ParallelTerminationStrategy: PID 3920 died... 19:02:50.934791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Terminated: ok {rc=0} 19:02:50.980812 --- ParallelTerminationStrategy: PID 3923 died... 19:02:51.000664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Terminated: ok {rc=0} 19:02:51.046746 --- ParallelTerminationStrategy: PID 3926 died... 19:02:51.066089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3926): Terminated: ok {rc=0} 19:02:51.153369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:02:52.303913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.315913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:02:52.388008 tst iperf3m4.py: using LAC 23072 19:02:52.516087 tst iperf3m4.py: using RAC 122 19:02:52.643460 tst iperf3m4.py: using CellId 23072 19:02:52.770699 tst iperf3m4.py: using BVCI 23073 19:02:52.889622 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.900884 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.912099 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.923440 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.934788 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.946169 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.957716 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.969113 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:02:52.980478 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:53.101204 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:53.225213 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:53.347780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:02:53.468881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:02:53.692107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:54.024171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3928): Launched 19:02:54.312129 run iperf3-srv_10.42.42.10(pid=3929): Launched 19:02:54.436192 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:02:54.659343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:54.990732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3930): Launched 19:02:55.278580 run iperf3-srv_10.42.42.10(pid=3931): Launched 19:02:55.403743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:02:55.626960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:55.958070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3932): Launched 19:02:56.245515 run iperf3-srv_10.42.42.10(pid=3933): Launched 19:02:56.368678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:02:56.591605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:56.922546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3934): Launched 19:02:57.209813 run iperf3-srv_10.42.42.10(pid=3935): Launched 19:02:57.332379 tst iperf3m4.py:8: start network... 19:02:57.555113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:58.064414 run create_hlr_db(pid=3936): Launched 19:02:58.191124 bus /gobi_6: Setting Powered False 19:02:59.255295 run create_hlr_db(pid=3936): Terminated: ok {rc=0} 19:02:59.713632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Launched 19:03:00.043622 run osmo-hlr_10.42.42.2(pid=3939): Launched 19:03:00.171002 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:00.740472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Launched 19:03:01.097710 run osmo-stp_10.42.42.5(pid=3942): Launched 19:03:01.342256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:02.010426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Launched 19:03:02.156129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:02.419682 run patchelf(pid=3946): Launched 19:03:02.591502 run osmo-stp_10.42.42.5(pid=3942): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] 19:03:02.721339 run osmo-stp_10.42.42.5(pid=3942): stdout: | (launched: 2022-12-09_19:03:01.037070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:02.852885 run osmo-stp_10.42.42.5(pid=3942): stderr: | [0;m[38;5;43m20221209190301361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190301361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190301365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190301366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:02.984584 run osmo-stp_10.42.42.5(pid=3942): stdout: | (launched: 2022-12-09_19:03:01.037070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:03.110303 run osmo-stp_10.42.42.5(pid=3942): stderr: | [0;m[38;5;43m20221209190301361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190301361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190301365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190301366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190301367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:03.259525 run patchelf(pid=3946): Terminating (SIGINT) 19:03:03.431779 run patchelf(pid=3946): Terminated: ok {rc=0} 19:03:03.555250 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3942): Process ended prematurely: osmo-stp_10.42.42.5(pid=3942) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:03:03.564712 tst iperf3m4.py:8: Test FAILED (11.3 sec) 19:03:03.592018 run osmo-hlr_10.42.42.2(pid=3939): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3939)] 19:03:03.639368 run osmo-hlr_10.42.42.2(pid=3939): stdout: | (launched: 2022-12-09_19:02:59.983460) 19:03:03.687912 run osmo-hlr_10.42.42.2(pid=3939): stderr: | [0;m[1;31m20221209190300179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190300179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190300179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190300179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190300180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190300180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190300197 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190300207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190300207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190300207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:03.736789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3928): Terminating (SIGTERM) 19:03:03.776407 run iperf3-srv_10.42.42.10(pid=3929): Terminating (SIGTERM) 19:03:03.815702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3930): Terminating (SIGTERM) 19:03:03.855177 run iperf3-srv_10.42.42.10(pid=3931): Terminating (SIGTERM) 19:03:03.894568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3932): Terminating (SIGTERM) 19:03:03.934103 run iperf3-srv_10.42.42.10(pid=3933): Terminating (SIGTERM) 19:03:03.973481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3934): Terminating (SIGTERM) 19:03:04.013042 run iperf3-srv_10.42.42.10(pid=3935): Terminating (SIGTERM) 19:03:04.052443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Terminating (SIGTERM) 19:03:04.091808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Terminating (SIGTERM) 19:03:04.131184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Terminating (SIGTERM) 19:03:04.170954 --- ParallelTerminationStrategy: PID 3928 died... 19:03:04.189885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3928): Terminated: ok {rc=0} 19:03:04.233655 --- ParallelTerminationStrategy: PID 3929 died... 19:03:04.252839 run iperf3-srv_10.42.42.10(pid=3929): Terminated {rc=256} 19:03:04.297143 --- ParallelTerminationStrategy: PID 3930 died... 19:03:04.315683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3930): Terminated: ok {rc=0} 19:03:04.359639 --- ParallelTerminationStrategy: PID 3931 died... 19:03:04.378192 run iperf3-srv_10.42.42.10(pid=3931): Terminated {rc=256} 19:03:04.421886 --- ParallelTerminationStrategy: PID 3932 died... 19:03:04.440261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3932): Terminated: ok {rc=0} 19:03:04.484619 --- ParallelTerminationStrategy: PID 3933 died... 19:03:04.503121 run iperf3-srv_10.42.42.10(pid=3933): Terminated {rc=256} 19:03:04.546827 --- ParallelTerminationStrategy: PID 3934 died... 19:03:04.565470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3934): Terminated: ok {rc=0} 19:03:04.609260 --- ParallelTerminationStrategy: PID 3935 died... 19:03:04.627740 run iperf3-srv_10.42.42.10(pid=3935): Terminated {rc=256} 19:03:04.671549 --- ParallelTerminationStrategy: PID 3938 died... 19:03:04.690047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Terminated: ok {rc=0} 19:03:04.733852 --- ParallelTerminationStrategy: PID 3941 died... 19:03:04.752448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Terminated: ok {rc=0} 19:03:04.796282 --- ParallelTerminationStrategy: PID 3945 died... 19:03:04.814973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Terminated: ok {rc=0} 19:03:04.899600 bus /gobi_4: Setting Powered False 19:03:06.000720 bus /gobi_4: Setting Powered False 19:03:07.116221 bus /gobi_1: Setting Powered False 19:03:08.218499 bus /gobi_1: Setting Powered False 19:03:09.335356 bus /gobi_0: Setting Powered False 19:03:10.434047 bus /gobi_0: Setting Powered False 19:03:11.550348 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:03:12.652170 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:12.664367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:03:12.737814 tst ping.py: using LAC 23073 19:03:12.865708 tst ping.py: using RAC 123 19:03:12.994348 tst ping.py: using CellId 23073 19:03:13.121416 tst ping.py: using BVCI 23074 19:03:13.240938 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.252413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.263578 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.275100 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.286445 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.297731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.309215 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:13.320501 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:03:13.436615 tst ping.py:19: start network... 19:03:13.639887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:14.108709 run create_hlr_db(pid=3947): Launched 19:03:14.232422 bus /gobi_6: Setting Powered False 19:03:15.293485 run create_hlr_db(pid=3947): Terminated: ok {rc=0} 19:03:15.736055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Launched 19:03:16.098263 run osmo-hlr_10.42.42.2(pid=3950): Launched 19:03:16.345443 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:17.027820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Launched 19:03:17.365682 run osmo-stp_10.42.42.5(pid=3953): Launched 19:03:17.492131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:18.050821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3955): Launched 19:03:18.175261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:18.448909 run patchelf(pid=3956): Launched 19:03:18.627987 run osmo-stp_10.42.42.5(pid=3953): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] 19:03:18.764394 run osmo-stp_10.42.42.5(pid=3953): stdout: | (launched: 2022-12-09_19:03:17.306371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:18.902542 run osmo-stp_10.42.42.5(pid=3953): stderr: | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190317499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:19.040869 run osmo-stp_10.42.42.5(pid=3953): stdout: | (launched: 2022-12-09_19:03:17.306371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:19.173256 run osmo-stp_10.42.42.5(pid=3953): stderr: | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190317498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190317499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190317499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:19.330250 run patchelf(pid=3956): Terminating (SIGINT) 19:03:19.511037 run patchelf(pid=3956): Terminated: ok {rc=0} 19:03:19.641339 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3953): Process ended prematurely: osmo-stp_10.42.42.5(pid=3953) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 19:03:19.650980 tst ping.py:22: Test FAILED (7.0 sec) 19:03:19.679647 run osmo-hlr_10.42.42.2(pid=3950): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3950)] 19:03:19.729629 run osmo-hlr_10.42.42.2(pid=3950): stdout: | (launched: 2022-12-09_19:03:16.038642) 19:03:19.781101 run osmo-hlr_10.42.42.2(pid=3950): stderr: | [0;m[1;31m20221209190316341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190316341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190316341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190316341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190316342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190316342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190316362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190316370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190316370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190316370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:19.833105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Terminating (SIGTERM) 19:03:19.874821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Terminating (SIGTERM) 19:03:19.916507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3955): Terminating (SIGTERM) 19:03:19.958552 --- ParallelTerminationStrategy: PID 3949 died... 19:03:19.978545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Terminated: ok {rc=0} 19:03:20.025066 --- ParallelTerminationStrategy: PID 3952 died... 19:03:20.044814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Terminated: ok {rc=0} 19:03:20.091259 --- ParallelTerminationStrategy: PID 3955 died... 19:03:20.110679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3955): Terminated: ok {rc=0} 19:03:20.198470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:03:21.286852 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.299277 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:03:21.373861 tst ping_idle_ping.py: using LAC 23074 19:03:21.503128 tst ping_idle_ping.py: using RAC 124 19:03:21.631401 tst ping_idle_ping.py: using CellId 23074 19:03:21.760685 tst ping_idle_ping.py: using BVCI 23075 19:03:21.871792 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.883091 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.893913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.904756 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.915608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.926554 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.937484 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:21.948228 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:03:22.067032 tst ping_idle_ping.py:24: start network... 19:03:22.286490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:22.793660 run create_hlr_db(pid=3957): Launched 19:03:22.917518 bus /gobi_6: Setting Powered False 19:03:23.981660 run create_hlr_db(pid=3957): Terminated: ok {rc=0} 19:03:24.417554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3959): Launched 19:03:24.721731 run osmo-hlr_10.42.42.2(pid=3960): Launched 19:03:24.836699 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:25.358978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3962): Launched 19:03:25.662937 run osmo-stp_10.42.42.5(pid=3963): Launched 19:03:25.779242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:26.301177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3965): Launched 19:03:26.416802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:26.672309 run patchelf(pid=3966): Launched 19:03:26.840041 run osmo-stp_10.42.42.5(pid=3963): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3963)] 19:03:26.967737 run osmo-stp_10.42.42.5(pid=3963): stdout: | (launched: 2022-12-09_19:03:25.607337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:27.097111 run osmo-stp_10.42.42.5(pid=3963): stderr: | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190325775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:27.226324 run osmo-stp_10.42.42.5(pid=3963): stdout: | (launched: 2022-12-09_19:03:25.607337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:27.350161 run osmo-stp_10.42.42.5(pid=3963): stderr: | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190325775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190325775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190325776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:27.497095 run patchelf(pid=3966): Terminating (SIGINT) 19:03:27.667194 run patchelf(pid=3966): Terminated: ok {rc=0} 19:03:27.788875 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3963): Process ended prematurely: osmo-stp_10.42.42.5(pid=3963) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3963)] [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:03:27.798294 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:03:27.824786 run osmo-hlr_10.42.42.2(pid=3960): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3960)] 19:03:27.871636 run osmo-hlr_10.42.42.2(pid=3960): stdout: | (launched: 2022-12-09_19:03:24.666065) 19:03:27.920228 run osmo-hlr_10.42.42.2(pid=3960): stderr: | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190324839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190324852 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190324861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190324861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190324861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:27.969437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3959): Terminating (SIGTERM) 19:03:28.008761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3962): Terminating (SIGTERM) 19:03:28.048021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3965): Terminating (SIGTERM) 19:03:28.087496 --- ParallelTerminationStrategy: PID 3959 died... 19:03:28.105985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3959): Terminated: ok {rc=0} 19:03:28.149520 --- ParallelTerminationStrategy: PID 3962 died... 19:03:28.167943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3962): Terminated: ok {rc=0} 19:03:28.211462 --- ParallelTerminationStrategy: PID 3965 died... 19:03:28.230059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3965): Terminated: ok {rc=0} 19:03:28.315111 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:03:29.628019 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:29.635142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:03:29.671282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:03:29.711079 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:03:29.799461 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:03:29.833668 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:03:29.873075 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:03:30.470319 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:03:30.520079 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:30.531435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:03:30.582021 tst cs_paging_gprs_active.py: using LAC 23075 19:03:30.701402 tst cs_paging_gprs_active.py: using RAC 125 19:03:30.825371 tst cs_paging_gprs_active.py: using CellId 23075 19:03:30.952034 tst cs_paging_gprs_active.py: using BVCI 23076 19:03:31.065834 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.077704 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.089282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.100808 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.112461 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.124096 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.135848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.147435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:31.159382 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:31.306750 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:31.431221 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:03:31.644891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:31.960838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Launched 19:03:32.245538 run iperf3-srv_10.42.42.10(pid=3971): Launched 19:03:32.383130 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:03:32.608329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:32.941256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3972): Launched 19:03:33.230023 run iperf3-srv_10.42.42.10(pid=3973): Launched 19:03:33.354014 tst cs_paging_gprs_active.py:38: start network... 19:03:33.578465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:34.090012 run create_hlr_db(pid=3974): Launched 19:03:34.217359 bus /gobi_6: Setting Powered False 19:03:35.282333 run create_hlr_db(pid=3974): Terminated: ok {rc=0} 19:03:35.741282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Launched 19:03:36.070227 run osmo-hlr_10.42.42.2(pid=3977): Launched 19:03:36.197344 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:36.764216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Launched 19:03:37.093744 run osmo-stp_10.42.42.5(pid=3980): Launched 19:03:37.221524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:37.792402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3982): Launched 19:03:37.919821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:38.199370 run patchelf(pid=3983): Launched 19:03:38.383943 run osmo-stp_10.42.42.5(pid=3980): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] 19:03:38.523416 run osmo-stp_10.42.42.5(pid=3980): stdout: | (launched: 2022-12-09_19:03:37.033583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:38.664260 run osmo-stp_10.42.42.5(pid=3980): stderr: | [0;m[38;5;43m20221209190337222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190337222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190337223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190337223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190337223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190337224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190337224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:38.804535 run osmo-stp_10.42.42.5(pid=3980): stdout: | (launched: 2022-12-09_19:03:37.033583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:38.939674 run osmo-stp_10.42.42.5(pid=3980): stderr: | [0;m[38;5;43m20221209190337222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190337222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190337223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190337223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190337223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190337224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190337224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:39.099710 run patchelf(pid=3983): Terminating (SIGINT) 19:03:39.283508 run patchelf(pid=3983): Terminated: ok {rc=0} 19:03:39.416901 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3980): Process ended prematurely: osmo-stp_10.42.42.5(pid=3980) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:03:39.427272 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:03:39.456672 run osmo-hlr_10.42.42.2(pid=3977): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3977)] 19:03:39.507125 run osmo-hlr_10.42.42.2(pid=3977): stdout: | (launched: 2022-12-09_19:03:36.010091) 19:03:39.559260 run osmo-hlr_10.42.42.2(pid=3977): stderr: | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190336208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190336222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190336231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190336231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190336231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:39.611682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Terminating (SIGTERM) 19:03:39.653865 run iperf3-srv_10.42.42.10(pid=3971): Terminating (SIGTERM) 19:03:39.696382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3972): Terminating (SIGTERM) 19:03:39.738734 run iperf3-srv_10.42.42.10(pid=3973): Terminating (SIGTERM) 19:03:39.780822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Terminating (SIGTERM) 19:03:39.823196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Terminating (SIGTERM) 19:03:39.865304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3982): Terminating (SIGTERM) 19:03:39.907644 --- ParallelTerminationStrategy: PID 3970 died... 19:03:39.927733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Terminated: ok {rc=0} 19:03:39.974691 --- ParallelTerminationStrategy: PID 3971 died... 19:03:39.994390 run iperf3-srv_10.42.42.10(pid=3971): Terminated {rc=256} 19:03:40.041058 --- ParallelTerminationStrategy: PID 3972 died... 19:03:40.060779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3972): Terminated: ok {rc=0} 19:03:40.107416 --- ParallelTerminationStrategy: PID 3973 died... 19:03:40.127038 run iperf3-srv_10.42.42.10(pid=3973): Terminated {rc=256} 19:03:40.173457 --- ParallelTerminationStrategy: PID 3976 died... 19:03:40.193024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Terminated: ok {rc=0} 19:03:40.239651 --- ParallelTerminationStrategy: PID 3979 died... 19:03:40.259178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Terminated: ok {rc=0} 19:03:40.305480 --- ParallelTerminationStrategy: PID 3982 died... 19:03:40.325426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3982): Terminated: ok {rc=0} 19:03:40.413794 bus /gobi_0: Setting Powered False 19:03:41.513769 bus /gobi_0: Setting Powered False 19:03:42.630944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:03:43.778629 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:43.790763 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:03:43.845941 tst iperf3.py: using LAC 23076 19:03:43.976550 tst iperf3.py: using RAC 126 19:03:44.106780 tst iperf3.py: using CellId 23076 19:03:44.227976 tst iperf3.py: using BVCI 23077 19:03:44.341257 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.353119 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.364551 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.375671 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.386716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.397931 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.409178 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.420093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:44.431353 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:44.551589 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:03:44.776398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:45.109388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3984): Launched 19:03:45.398059 run iperf3-srv_10.42.42.10(pid=3985): Launched 19:03:45.523376 tst iperf3.py:8: start network... 19:03:45.748293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:46.327042 run create_hlr_db(pid=3986): Launched 19:03:46.492428 bus /gobi_6: Setting Powered False 19:03:47.553936 run create_hlr_db(pid=3986): Terminated: ok {rc=0} 19:03:48.018453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Launched 19:03:48.349984 run osmo-hlr_10.42.42.2(pid=3989): Launched 19:03:48.478182 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:49.048255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Launched 19:03:49.377978 run osmo-stp_10.42.42.5(pid=3992): Launched 19:03:49.505868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:50.076644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3994): Launched 19:03:50.202185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:50.480792 run patchelf(pid=3995): Launched 19:03:50.663527 run osmo-stp_10.42.42.5(pid=3992): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] 19:03:50.802640 run osmo-stp_10.42.42.5(pid=3992): stdout: | (launched: 2022-12-09_19:03:49.317835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:50.943591 run osmo-stp_10.42.42.5(pid=3992): stderr: | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190349511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:51.084222 run osmo-stp_10.42.42.5(pid=3992): stdout: | (launched: 2022-12-09_19:03:49.317835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:51.219119 run osmo-stp_10.42.42.5(pid=3992): stderr: | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190349510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190349511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190349511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:51.378857 run patchelf(pid=3995): Terminating (SIGINT) 19:03:51.563072 run patchelf(pid=3995): Terminated: ok {rc=0} 19:03:51.695914 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3992): Process ended prematurely: osmo-stp_10.42.42.5(pid=3992) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:03:51.706292 tst iperf3.py:8: Test FAILED (8.0 sec) 19:03:51.735402 run osmo-hlr_10.42.42.2(pid=3989): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3989)] 19:03:51.785752 run osmo-hlr_10.42.42.2(pid=3989): stdout: | (launched: 2022-12-09_19:03:48.289838) 19:03:51.837618 run osmo-hlr_10.42.42.2(pid=3989): stderr: | [0;m[1;31m20221209190348488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190348488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190348488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190348488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190348488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190348489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190348504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190348512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190348512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190348512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:51.889841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3984): Terminating (SIGTERM) 19:03:51.931745 run iperf3-srv_10.42.42.10(pid=3985): Terminating (SIGTERM) 19:03:51.973484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Terminating (SIGTERM) 19:03:52.015255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Terminating (SIGTERM) 19:03:52.057242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3994): Terminating (SIGTERM) 19:03:52.099273 --- ParallelTerminationStrategy: PID 3984 died... 19:03:52.119112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3984): Terminated: ok {rc=0} 19:03:52.165852 --- ParallelTerminationStrategy: PID 3985 died... 19:03:52.185206 run iperf3-srv_10.42.42.10(pid=3985): Terminated {rc=256} 19:03:52.231325 --- ParallelTerminationStrategy: PID 3988 died... 19:03:52.250832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Terminated: ok {rc=0} 19:03:52.297284 --- ParallelTerminationStrategy: PID 3991 died... 19:03:52.316614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Terminated: ok {rc=0} 19:03:52.363160 --- ParallelTerminationStrategy: PID 3994 died... 19:03:52.382780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3994): Terminated: ok {rc=0} 19:03:52.471398 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:03:53.623003 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:53.635570 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:03:53.690292 tst iperf3m4.py: using LAC 23077 19:03:53.820045 tst iperf3m4.py: using RAC 127 19:03:53.950616 tst iperf3m4.py: using CellId 23077 19:03:54.079026 tst iperf3m4.py: using BVCI 23078 19:03:54.198174 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.209926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.221451 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.233387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.245143 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.256767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.268614 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.280753 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:03:54.292602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:54.414215 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:54.534363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:54.652081 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:03:54.773909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:03:54.998228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:55.330175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3996): Launched 19:03:55.617565 run iperf3-srv_10.42.42.10(pid=3997): Launched 19:03:55.742703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:03:55.966857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:56.298979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3998): Launched 19:03:56.587486 run iperf3-srv_10.42.42.10(pid=3999): Launched 19:03:56.711709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:03:56.934400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:57.265652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4000): Launched 19:03:57.553745 run iperf3-srv_10.42.42.10(pid=4001): Launched 19:03:57.677378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:03:57.900316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:58.232603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4002): Launched 19:03:58.520676 run iperf3-srv_10.42.42.10(pid=4003): Launched 19:03:58.645433 tst iperf3m4.py:8: start network... 19:03:58.867963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:59.377625 run create_hlr_db(pid=4004): Launched 19:03:59.505138 bus /gobi_6: Setting Powered False 19:04:00.569937 run create_hlr_db(pid=4004): Terminated: ok {rc=0} 19:04:01.038737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4006): Launched 19:04:01.365521 run osmo-hlr_10.42.42.2(pid=4007): Launched 19:04:01.579423 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:02.201890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4009): Launched 19:04:02.525979 run osmo-stp_10.42.42.5(pid=4010): Launched 19:04:02.643998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:03.174213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4012): Launched 19:04:03.292609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:03.552502 run patchelf(pid=4013): Launched 19:04:03.723353 run osmo-stp_10.42.42.5(pid=4010): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4010)] 19:04:03.854135 run osmo-stp_10.42.42.5(pid=4010): stdout: | (launched: 2022-12-09_19:04:02.469532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:03.986097 run osmo-stp_10.42.42.5(pid=4010): stderr: | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190402640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:04.117982 run osmo-stp_10.42.42.5(pid=4010): stdout: | (launched: 2022-12-09_19:04:02.469532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:04.243732 run osmo-stp_10.42.42.5(pid=4010): stderr: | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190402639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190402640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190402640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:04.393181 run patchelf(pid=4013): Terminating (SIGINT) 19:04:04.565550 run patchelf(pid=4013): Terminated: ok {rc=0} 19:04:04.689425 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4010): Process ended prematurely: osmo-stp_10.42.42.5(pid=4010) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4010)] [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:04:04.699010 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:04:04.726327 run osmo-hlr_10.42.42.2(pid=4007): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4007)] 19:04:04.773759 run osmo-hlr_10.42.42.2(pid=4007): stdout: | (launched: 2022-12-09_19:04:01.307203) 19:04:04.822385 run osmo-hlr_10.42.42.2(pid=4007): stderr: | [0;m[1;31m20221209190401688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190401688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190401688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190401691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190401691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190401691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190401709 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190401732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190401732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190401732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:04.871183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3996): Terminating (SIGTERM) 19:04:04.910418 run iperf3-srv_10.42.42.10(pid=3997): Terminating (SIGTERM) 19:04:04.949555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3998): Terminating (SIGTERM) 19:04:04.988836 run iperf3-srv_10.42.42.10(pid=3999): Terminating (SIGTERM) 19:04:05.028226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4000): Terminating (SIGTERM) 19:04:05.067729 run iperf3-srv_10.42.42.10(pid=4001): Terminating (SIGTERM) 19:04:05.106958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4002): Terminating (SIGTERM) 19:04:05.146211 run iperf3-srv_10.42.42.10(pid=4003): Terminating (SIGTERM) 19:04:05.185395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4006): Terminating (SIGTERM) 19:04:05.225055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4009): Terminating (SIGTERM) 19:04:05.264242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4012): Terminating (SIGTERM) 19:04:05.303795 --- ParallelTerminationStrategy: PID 3996 died... 19:04:05.322700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3996): Terminated: ok {rc=0} 19:04:05.366176 --- ParallelTerminationStrategy: PID 3997 died... 19:04:05.384366 run iperf3-srv_10.42.42.10(pid=3997): Terminated {rc=256} 19:04:05.427719 --- ParallelTerminationStrategy: PID 3998 died... 19:04:05.446229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3998): Terminated: ok {rc=0} 19:04:05.490438 --- ParallelTerminationStrategy: PID 3999 died... 19:04:05.508653 run iperf3-srv_10.42.42.10(pid=3999): Terminated {rc=256} 19:04:05.551914 --- ParallelTerminationStrategy: PID 4000 died... 19:04:05.570357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4000): Terminated: ok {rc=0} 19:04:05.613798 --- ParallelTerminationStrategy: PID 4001 died... 19:04:05.632055 run iperf3-srv_10.42.42.10(pid=4001): Terminated {rc=256} 19:04:05.675175 --- ParallelTerminationStrategy: PID 4002 died... 19:04:05.693890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4002): Terminated: ok {rc=0} 19:04:05.737030 --- ParallelTerminationStrategy: PID 4003 died... 19:04:05.755298 run iperf3-srv_10.42.42.10(pid=4003): Terminated {rc=256} 19:04:05.798399 --- ParallelTerminationStrategy: PID 4006 died... 19:04:05.816854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4006): Terminated: ok {rc=0} 19:04:05.860460 --- ParallelTerminationStrategy: PID 4009 died... 19:04:05.879243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4009): Terminated: ok {rc=0} 19:04:05.922633 --- ParallelTerminationStrategy: PID 4012 died... 19:04:05.941004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4012): Terminated: ok {rc=0} 19:04:06.026558 bus /gobi_4: Setting Powered False 19:04:07.124766 bus /gobi_4: Setting Powered False 19:04:08.238600 bus /gobi_1: Setting Powered False 19:04:09.336441 bus /gobi_1: Setting Powered False 19:04:10.452078 bus /gobi_0: Setting Powered False 19:04:11.549094 bus /gobi_0: Setting Powered False 19:04:12.666469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:04:13.768155 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:13.780145 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:04:13.833174 tst ping.py: using LAC 23078 19:04:13.951932 tst ping.py: using RAC 128 19:04:14.072666 tst ping.py: using CellId 23078 19:04:14.193119 tst ping.py: using BVCI 23079 19:04:14.303418 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.314841 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.325970 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.337672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.349167 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.360627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.372275 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:14.383767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:04:14.498216 tst ping.py:19: start network... 19:04:14.701202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:15.167966 run create_hlr_db(pid=4016): Launched 19:04:15.290833 bus /gobi_6: Setting Powered False 19:04:16.349770 run create_hlr_db(pid=4016): Terminated: ok {rc=0} 19:04:16.782455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Launched 19:04:17.104076 run osmo-hlr_10.42.42.2(pid=4019): Launched 19:04:17.276500 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:17.816300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Launched 19:04:18.118738 run osmo-stp_10.42.42.5(pid=4022): Launched 19:04:18.232574 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:18.753225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4024): Launched 19:04:18.867922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:19.122867 run patchelf(pid=4025): Launched 19:04:19.290378 run osmo-stp_10.42.42.5(pid=4022): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] 19:04:19.418533 run osmo-stp_10.42.42.5(pid=4022): stdout: | (launched: 2022-12-09_19:04:18.062876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:19.547704 run osmo-stp_10.42.42.5(pid=4022): stderr: | [0;m[38;5;43m20221209190418230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190418230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190418231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190418231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:19.677086 run osmo-stp_10.42.42.5(pid=4022): stdout: | (launched: 2022-12-09_19:04:18.062876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:19.800891 run osmo-stp_10.42.42.5(pid=4022): stderr: | [0;m[38;5;43m20221209190418230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190418230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190418231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190418231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190418232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:19.947723 run patchelf(pid=4025): Terminating (SIGINT) 19:04:20.118003 run patchelf(pid=4025): Terminated: ok {rc=0} 19:04:20.239792 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4022): Process ended prematurely: osmo-stp_10.42.42.5(pid=4022) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:04:20.248997 tst ping.py:22: Test FAILED (6.5 sec) 19:04:20.275604 run osmo-hlr_10.42.42.2(pid=4019): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4019)] 19:04:20.323007 run osmo-hlr_10.42.42.2(pid=4019): stdout: | (launched: 2022-12-09_19:04:17.046995) 19:04:20.371872 run osmo-hlr_10.42.42.2(pid=4019): stderr: | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190417295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190417307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190417316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190417316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190417316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:20.421316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Terminating (SIGTERM) 19:04:20.460694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Terminating (SIGTERM) 19:04:20.500071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4024): Terminating (SIGTERM) 19:04:20.539564 --- ParallelTerminationStrategy: PID 4018 died... 19:04:20.558485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Terminated: ok {rc=0} 19:04:20.601963 --- ParallelTerminationStrategy: PID 4021 died... 19:04:20.620631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Terminated: ok {rc=0} 19:04:20.664265 --- ParallelTerminationStrategy: PID 4024 died... 19:04:20.682776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4024): Terminated: ok {rc=0} 19:04:20.767376 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:04:21.854807 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:21.866810 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:04:21.919815 tst ping_idle_ping.py: using LAC 23079 19:04:22.041088 tst ping_idle_ping.py: using RAC 129 19:04:22.161092 tst ping_idle_ping.py: using CellId 23079 19:04:22.279490 tst ping_idle_ping.py: using BVCI 23080 19:04:22.390886 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.402275 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.413397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.424363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.435306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.446422 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.457555 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:22.468520 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:04:22.584203 tst ping_idle_ping.py:24: start network... 19:04:22.787836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:23.261874 run create_hlr_db(pid=4026): Launched 19:04:23.385375 bus /gobi_6: Setting Powered False 19:04:24.446486 run create_hlr_db(pid=4026): Terminated: ok {rc=0} 19:04:24.891092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Launched 19:04:25.216707 run osmo-hlr_10.42.42.2(pid=4029): Launched 19:04:25.342627 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:25.905164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Launched 19:04:26.229008 run osmo-stp_10.42.42.5(pid=4032): Launched 19:04:26.354477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:26.915102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4034): Launched 19:04:27.040728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:27.314497 run patchelf(pid=4035): Launched 19:04:27.496511 run osmo-stp_10.42.42.5(pid=4032): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4032)] 19:04:27.633599 run osmo-stp_10.42.42.5(pid=4032): stdout: | (launched: 2022-12-09_19:04:26.169657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:27.771967 run osmo-stp_10.42.42.5(pid=4032): stderr: | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190426361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:27.911134 run osmo-stp_10.42.42.5(pid=4032): stdout: | (launched: 2022-12-09_19:04:26.169657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:28.044070 run osmo-stp_10.42.42.5(pid=4032): stderr: | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190426361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190426361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190426362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:28.202187 run patchelf(pid=4035): Terminating (SIGINT) 19:04:28.383092 run patchelf(pid=4035): Terminated: ok {rc=0} 19:04:28.513966 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4032): Process ended prematurely: osmo-stp_10.42.42.5(pid=4032) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4032)] [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:04:28.523741 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:04:28.552360 run osmo-hlr_10.42.42.2(pid=4029): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4029)] 19:04:28.602189 run osmo-hlr_10.42.42.2(pid=4029): stdout: | (launched: 2022-12-09_19:04:25.157570) 19:04:28.654030 run osmo-hlr_10.42.42.2(pid=4029): stderr: | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190425352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190425364 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190425373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190425373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190425373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:28.706751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminating (SIGTERM) 19:04:28.748402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminating (SIGTERM) 19:04:28.790362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4034): Terminating (SIGTERM) 19:04:28.832382 --- ParallelTerminationStrategy: PID 4028 died... 19:04:28.852139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminated: ok {rc=0} 19:04:28.898361 --- ParallelTerminationStrategy: PID 4031 died... 19:04:28.917842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminated: ok {rc=0} 19:04:28.963933 --- ParallelTerminationStrategy: PID 4034 died... 19:04:28.983294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4034): Terminated: ok {rc=0} 19:04:29.070223 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:04:30.384376 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:30.391638 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:04:30.426580 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:04:30.461885 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:04:30.516345 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:04:30.550424 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:04:30.585763 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:04:31.143893 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:04:31.152391 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.168193 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:04:31.245662 tst switch_tch_pdch.py: using LAC 23080 19:04:31.378178 tst switch_tch_pdch.py: using RAC 130 19:04:31.547142 tst switch_tch_pdch.py: using CellId 23080 19:04:31.678220 tst switch_tch_pdch.py: using BVCI 23081 19:04:31.799223 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.811607 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.823581 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.836138 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.848156 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.861100 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.873733 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:04:31.886045 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:04:32.009381 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:04:32.127024 tst switch_tch_pdch.py:51: start network... 19:04:32.335937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:32.807201 run create_hlr_db(pid=4040): Launched 19:04:32.931391 bus /gobi_6: Setting Powered False 19:04:33.991458 run create_hlr_db(pid=4040): Terminated: ok {rc=0} 19:04:34.435055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Launched 19:04:34.760670 run osmo-hlr_10.42.42.2(pid=4043): Launched 19:04:34.883177 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:35.445466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Launched 19:04:35.770618 run osmo-stp_10.42.42.5(pid=4046): Launched 19:04:35.893823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:36.453395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Launched 19:04:36.576510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:36.848935 run patchelf(pid=4049): Launched 19:04:37.029206 run osmo-stp_10.42.42.5(pid=4046): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] 19:04:37.165842 run osmo-stp_10.42.42.5(pid=4046): stdout: | (launched: 2022-12-09_19:04:35.711180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:37.305692 run osmo-stp_10.42.42.5(pid=4046): stderr: | [0;m[38;5;43m20221209190435901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190435902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190435902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190435902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:37.449660 run osmo-stp_10.42.42.5(pid=4046): stdout: | (launched: 2022-12-09_19:04:35.711180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:37.585366 run osmo-stp_10.42.42.5(pid=4046): stderr: | [0;m[38;5;43m20221209190435901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190435902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190435902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190435902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190435903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:37.742646 run patchelf(pid=4049): Terminating (SIGINT) 19:04:37.922796 run patchelf(pid=4049): Terminated: ok {rc=0} 19:04:38.052839 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4046): Process ended prematurely: osmo-stp_10.42.42.5(pid=4046) [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:04:38.062622 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:04:38.091234 run osmo-hlr_10.42.42.2(pid=4043): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4043)] 19:04:38.141590 run osmo-hlr_10.42.42.2(pid=4043): stdout: | (launched: 2022-12-09_19:04:34.701437) 19:04:38.193528 run osmo-hlr_10.42.42.2(pid=4043): stderr: | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190434899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190434916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190434925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190434925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190434925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:38.245648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Terminating (SIGTERM) 19:04:38.287609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Terminating (SIGTERM) 19:04:38.329884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Terminating (SIGTERM) 19:04:38.372192 --- ParallelTerminationStrategy: PID 4042 died... 19:04:38.392016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Terminated: ok {rc=0} 19:04:38.439334 --- ParallelTerminationStrategy: PID 4045 died... 19:04:38.458989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Terminated: ok {rc=0} 19:04:38.505448 --- ParallelTerminationStrategy: PID 4048 died... 19:04:38.525022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Terminated: ok {rc=0} 19:04:38.613334 bus /gobi_0: Setting Powered False 19:04:39.712087 bus /gobi_0: Setting Powered False 19:04:40.829523 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:04:42.079782 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:42.085817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:04:42.118364 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:04:42.152147 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:04:42.204572 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:04:42.237171 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:04:42.270952 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:04:42.825917 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:04:42.830831 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:42.841861 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:04:42.909256 tst switch_tch_pdch.py: using LAC 23081 19:04:43.027274 tst switch_tch_pdch.py: using RAC 131 19:04:43.155972 tst switch_tch_pdch.py: using CellId 23081 19:04:43.282225 tst switch_tch_pdch.py: using BVCI 23082 19:04:43.401803 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.413734 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.425203 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.436579 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.448013 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.459363 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.470979 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:04:43.482439 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:04:43.598559 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:04:43.718134 tst switch_tch_pdch.py:51: start network... 19:04:43.937726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:44.412684 run create_hlr_db(pid=4053): Launched 19:04:44.536059 bus /gobi_6: Setting Powered False 19:04:45.601156 run create_hlr_db(pid=4053): Terminated: ok {rc=0} 19:04:46.033697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Launched 19:04:46.351992 run osmo-hlr_10.42.42.2(pid=4056): Launched 19:04:46.608734 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:47.185672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Launched 19:04:47.498867 run osmo-stp_10.42.42.5(pid=4059): Launched 19:04:47.615350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:48.113826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4061): Launched 19:04:48.228938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:48.483640 run patchelf(pid=4062): Launched 19:04:48.650522 run osmo-stp_10.42.42.5(pid=4059): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] 19:04:48.778155 run osmo-stp_10.42.42.5(pid=4059): stdout: | (launched: 2022-12-09_19:04:47.442866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:48.906870 run osmo-stp_10.42.42.5(pid=4059): stderr: | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190447610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:49.036095 run osmo-stp_10.42.42.5(pid=4059): stdout: | (launched: 2022-12-09_19:04:47.442866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:49.159520 run osmo-stp_10.42.42.5(pid=4059): stderr: | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190447609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190447610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190447610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:49.306089 run patchelf(pid=4062): Terminating (SIGINT) 19:04:49.474420 run patchelf(pid=4062): Terminated: ok {rc=0} 19:04:49.595442 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4059): Process ended prematurely: osmo-stp_10.42.42.5(pid=4059) [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:04:49.604548 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 19:04:49.631046 run osmo-hlr_10.42.42.2(pid=4056): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4056)] 19:04:49.678546 run osmo-hlr_10.42.42.2(pid=4056): stdout: | (launched: 2022-12-09_19:04:46.294793) 19:04:49.727638 run osmo-hlr_10.42.42.2(pid=4056): stderr: | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190446546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190446558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190446575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190446575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190446575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:49.777089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Terminating (SIGTERM) 19:04:49.816692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Terminating (SIGTERM) 19:04:49.856317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4061): Terminating (SIGTERM) 19:04:49.896297 --- ParallelTerminationStrategy: PID 4055 died... 19:04:49.915174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Terminated: ok {rc=0} 19:04:49.959061 --- ParallelTerminationStrategy: PID 4058 died... 19:04:49.977691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Terminated: ok {rc=0} 19:04:50.021269 --- ParallelTerminationStrategy: PID 4061 died... 19:04:50.039622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4061): Terminated: ok {rc=0} 19:04:50.125079 bus /gobi_0: Setting Powered False 19:04:51.225198 bus /gobi_0: Setting Powered False 19:04:52.341039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:04:53.591886 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:53.595753 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:04:53.628916 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:04:53.635618 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:04:53.691931 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:04:53.725051 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:04:53.731807 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:04:54.264858 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:04:54.269751 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:04:54.280599 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:04:54.327956 tst mo_mt_sms.py: using LAC 23082 19:04:54.457725 tst mo_mt_sms.py: using RAC 132 19:04:54.579716 tst mo_mt_sms.py: using CellId 23082 19:04:54.696298 tst mo_mt_sms.py: using BVCI 23083 19:04:54.805457 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:04:54.923900 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:04:55.039076 tst mo_mt_sms.py:9: start nitb and bts... 19:04:55.259548 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:04:55.918065 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Launched 19:04:56.242629 run osmo-nitb_10.42.42.2(pid=4067): Launched 19:04:56.422453 run osmo-nitb_10.42.42.2(pid=4067): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] 19:04:56.566973 run osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-09_19:04:56.183566) 19:04:56.712503 run osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-09_19:04:56.231625) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:04:56.858184 run osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-09_19:04:56.183566) 19:04:56.998097 run osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-09_19:04:56.231625) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2363↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] 19:04:57.365710 tst osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-09_19:04:56.183566) 19:04:57.496546 tst osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-09_19:04:56.231625) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:04:57.650852 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2363↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] [trial-2363↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 19:04:57.659931 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 19:04:57.667149 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Terminating (SIGTERM) 19:04:57.878104 --- ParallelTerminationStrategy: PID 4066 died... 19:04:57.899941 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Terminated: ok {rc=0} 19:04:57.989556 bus /sierra_3: Setting Powered False 19:04:59.090911 bus /sierra_3: Setting Powered False 19:05:00.209542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:05:01.424101 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:01.428549 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:05:01.468245 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:05:01.497685 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:05:01.550062 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:05:01.586939 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:05:01.615784 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:05:02.165178 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:05:02.173805 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.188435 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:05:02.242093 tst mo_mt_sms.py: using LAC 23083 19:05:02.371936 tst mo_mt_sms.py: using RAC 133 19:05:02.490617 tst mo_mt_sms.py: using CellId 23083 19:05:02.609484 tst mo_mt_sms.py: using BVCI 23084 19:05:02.728282 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.739648 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.750659 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.762001 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.773463 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:02.784653 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:05:02.904161 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:05:03.022565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:03.524348 run create_hlr_db(pid=4074): Launched 19:05:03.647984 bus /sierra_2: Setting Powered False 19:05:04.712656 run create_hlr_db(pid=4074): Terminated: ok {rc=0} 19:05:05.146025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4076): Launched 19:05:05.447632 run osmo-hlr_10.42.42.2(pid=4077): Launched 19:05:05.563865 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:06.094800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4079): Launched 19:05:06.396339 run osmo-stp_10.42.42.5(pid=4080): Launched 19:05:06.510153 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:07.054825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4082): Launched 19:05:07.356635 run osmo-msc_10.42.42.6(pid=4083): Launched 19:05:07.525913 run osmo-stp_10.42.42.5(pid=4080): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4080)] 19:05:07.653323 run osmo-stp_10.42.42.5(pid=4080): stdout: | (launched: 2022-12-09_19:05:06.339665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:07.780662 run osmo-stp_10.42.42.5(pid=4080): stderr: | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190506513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:07.906626 run osmo-stp_10.42.42.5(pid=4080): stdout: | (launched: 2022-12-09_19:05:06.339665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:08.027258 run osmo-stp_10.42.42.5(pid=4080): stderr: | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190506512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190506513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190506513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:08.171661 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4080): Process ended prematurely: osmo-stp_10.42.42.5(pid=4080) [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4080)] [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 19:05:08.180216 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 19:05:08.206398 run osmo-hlr_10.42.42.2(pid=4077): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4077)] 19:05:08.253951 run osmo-hlr_10.42.42.2(pid=4077): stdout: | (launched: 2022-12-09_19:05:05.391959) 19:05:08.302996 run osmo-hlr_10.42.42.2(pid=4077): stderr: | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190505569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190505581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190505590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190505590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190505590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:08.371793 run osmo-msc_10.42.42.6(pid=4083): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4083)] 19:05:08.419194 run osmo-msc_10.42.42.6(pid=4083): stdout: | (launched: 2022-12-09_19:05:07.300779) 19:05:08.468013 run osmo-msc_10.42.42.6(pid=4083): stderr: | [0;m[38;5;43m20221209190507573 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190507573 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38a9b84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190507573 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190507573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190507573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190507574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190507576 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190507577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190507577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190507577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:08.517528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4076): Terminating (SIGTERM) 19:05:08.556836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4079): Terminating (SIGTERM) 19:05:08.596257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4082): Terminating (SIGTERM) 19:05:08.635787 --- ParallelTerminationStrategy: PID 4076 died... 19:05:08.654940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4076): Terminated: ok {rc=0} 19:05:08.698975 --- ParallelTerminationStrategy: PID 4079 died... 19:05:08.717611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4079): Terminated: ok {rc=0} 19:05:08.761248 --- ParallelTerminationStrategy: PID 4082 died... 19:05:08.779724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4082): Terminated: ok {rc=0} 19:05:08.866049 bus /sierra_3: Setting Powered False 19:05:09.965453 bus /sierra_3: Setting Powered False 19:05:11.081876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:05:12.315644 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:12.319489 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:05:12.353264 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:05:12.360138 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:05:12.395082 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:05:12.428713 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:05:12.435544 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:05:12.957822 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:05:12.963272 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:05:12.974863 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:05:13.024817 tst assert_extension.py: using LAC 23084 19:05:13.153225 tst assert_extension.py: using RAC 134 19:05:13.279349 tst assert_extension.py: using CellId 23084 19:05:13.405411 tst assert_extension.py: using BVCI 23085 19:05:13.515892 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:05:13.633162 tst assert_extension.py:10: start nitb and bts... 19:05:13.851312 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:05:14.512654 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4089): Launched 19:05:14.836246 run osmo-nitb_10.42.42.2(pid=4090): Launched 19:05:15.015230 run osmo-nitb_10.42.42.2(pid=4090): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4090)] 19:05:15.159374 run osmo-nitb_10.42.42.2(pid=4090): stdout: | (launched: 2022-12-09_19:05:14.777255) 19:05:15.305569 run osmo-nitb_10.42.42.2(pid=4090): stderr: | (launched: 2022-12-09_19:05:14.825414) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:05:15.452201 run osmo-nitb_10.42.42.2(pid=4090): stdout: | (launched: 2022-12-09_19:05:14.777255) 19:05:15.592399 run osmo-nitb_10.42.42.2(pid=4090): stderr: | (launched: 2022-12-09_19:05:14.825414) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4090) [trial-2363↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4090)] 19:05:15.958509 tst osmo-nitb_10.42.42.2(pid=4090): stdout: | (launched: 2022-12-09_19:05:14.777255) 19:05:16.094457 tst osmo-nitb_10.42.42.2(pid=4090): stderr: | (launched: 2022-12-09_19:05:14.825414) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:05:16.253242 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4090) [trial-2363↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4090)] [trial-2363↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 19:05:16.263973 tst assert_extension.py:12: Test FAILED (3.3 sec) 19:05:16.272307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4089): Terminating (SIGTERM) 19:05:16.486996 --- ParallelTerminationStrategy: PID 4089 died... 19:05:16.507882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4089): Terminated: ok {rc=0} 19:05:16.600466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:05:17.786273 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:17.791312 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:05:17.825264 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:05:17.851697 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:05:17.886538 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:05:17.920599 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:05:17.947118 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:05:18.482647 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:05:18.488568 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:18.500040 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:05:18.555701 tst assert_extension.py: using LAC 23085 19:05:18.681458 tst assert_extension.py: using RAC 135 19:05:18.808564 tst assert_extension.py: using CellId 23085 19:05:18.933455 tst assert_extension.py: using BVCI 23086 19:05:19.052853 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:19.064306 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:19.075379 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:19.086865 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:19.098316 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:05:19.109622 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:05:19.226391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:19.693651 run create_hlr_db(pid=4094): Launched 19:05:19.817281 bus /sierra_2: Setting Powered False 19:05:20.877596 run create_hlr_db(pid=4094): Terminated: ok {rc=0} 19:05:21.318179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4096): Launched 19:05:21.644267 run osmo-hlr_10.42.42.2(pid=4097): Launched 19:05:21.770015 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:22.417563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4099): Launched 19:05:22.719655 run osmo-stp_10.42.42.5(pid=4100): Launched 19:05:22.833262 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:23.373628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4102): Launched 19:05:23.671461 run osmo-msc_10.42.42.6(pid=4103): Launched 19:05:23.837346 run osmo-stp_10.42.42.5(pid=4100): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4100)] 19:05:23.963197 run osmo-stp_10.42.42.5(pid=4100): stdout: | (launched: 2022-12-09_19:05:22.664877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:24.088841 run osmo-stp_10.42.42.5(pid=4100): stderr: | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190522834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:24.212785 run osmo-stp_10.42.42.5(pid=4100): stdout: | (launched: 2022-12-09_19:05:22.664877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:24.331567 run osmo-stp_10.42.42.5(pid=4100): stderr: | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190522833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190522834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190522834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:24.474471 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4100): Process ended prematurely: osmo-stp_10.42.42.5(pid=4100) [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4100)] [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py:17] 19:05:24.483011 tst assert_extension.py:17: Test FAILED (6.0 sec) 19:05:24.509544 run osmo-hlr_10.42.42.2(pid=4097): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4097)] 19:05:24.557370 run osmo-hlr_10.42.42.2(pid=4097): stdout: | (launched: 2022-12-09_19:05:21.585136) 19:05:24.606144 run osmo-hlr_10.42.42.2(pid=4097): stderr: | [0;m[1;31m20221209190521781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190521781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190521781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190521781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190521781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190521782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190521794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190521803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190521803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190521803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:24.674196 run osmo-msc_10.42.42.6(pid=4103): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4103)] 19:05:24.721523 run osmo-msc_10.42.42.6(pid=4103): stdout: | (launched: 2022-12-09_19:05:23.616553) 19:05:24.769891 run osmo-msc_10.42.42.6(pid=4103): stderr: | [0;m[38;5;43m20221209190523888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190523888 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f69b50aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190523888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190523889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190523889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190523889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190523891 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190523891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190523891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190523891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:24.818799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4096): Terminating (SIGTERM) 19:05:24.858278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4099): Terminating (SIGTERM) 19:05:24.897511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4102): Terminating (SIGTERM) 19:05:24.937208 --- ParallelTerminationStrategy: PID 4096 died... 19:05:24.956137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4096): Terminated: ok {rc=0} 19:05:24.999860 --- ParallelTerminationStrategy: PID 4099 died... 19:05:25.018238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4099): Terminated: ok {rc=0} 19:05:25.061643 --- ParallelTerminationStrategy: PID 4102 died... 19:05:25.079986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4102): Terminated: ok {rc=0} 19:05:25.165345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:05:26.382319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:26.390040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:05:26.424356 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:05:26.450908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:05:26.500942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:05:26.534879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:05:26.561311 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:05:27.113860 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:05:27.163918 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.175182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:05:27.243341 tst mo_mt_call.py: using LAC 23086 19:05:27.361547 tst mo_mt_call.py: using RAC 136 19:05:27.479266 tst mo_mt_call.py: using CellId 23086 19:05:27.597774 tst mo_mt_call.py: using BVCI 23087 19:05:27.717085 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.728786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.740382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.752390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.764558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:27.776841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:05:27.892212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:05:28.011902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:28.483804 run create_hlr_db(pid=4108): Launched 19:05:28.609109 bus /sierra_2: Setting Powered False 19:05:29.669298 run create_hlr_db(pid=4108): Terminated: ok {rc=0} 19:05:30.112415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4110): Launched 19:05:30.437277 run osmo-hlr_10.42.42.2(pid=4111): Launched 19:05:30.563002 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:31.131265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4113): Launched 19:05:31.522861 run osmo-stp_10.42.42.5(pid=4114): Launched 19:05:31.666917 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:32.411079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4116): Launched 19:05:32.739939 run osmo-msc_10.42.42.6(pid=4117): Launched 19:05:32.920651 run osmo-stp_10.42.42.5(pid=4114): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4114)] 19:05:33.057661 run osmo-stp_10.42.42.5(pid=4114): stdout: | (launched: 2022-12-09_19:05:31.462343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:33.195118 run osmo-stp_10.42.42.5(pid=4114): stderr: | [0;m[38;5;43m20221209190531817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190531818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:33.331474 run osmo-stp_10.42.42.5(pid=4114): stdout: | (launched: 2022-12-09_19:05:31.462343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:33.461760 run osmo-stp_10.42.42.5(pid=4114): stderr: | [0;m[38;5;43m20221209190531817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190531818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190531819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:33.617420 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4114): Process ended prematurely: osmo-stp_10.42.42.5(pid=4114) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4114)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:05:33.627109 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:05:33.655799 run osmo-hlr_10.42.42.2(pid=4111): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4111)] 19:05:33.706064 run osmo-hlr_10.42.42.2(pid=4111): stdout: | (launched: 2022-12-09_19:05:30.378187) 19:05:33.758124 run osmo-hlr_10.42.42.2(pid=4111): stderr: | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190530575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190530588 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190530596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190530596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190530596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:33.830161 run osmo-msc_10.42.42.6(pid=4117): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4117)] 19:05:33.880431 run osmo-msc_10.42.42.6(pid=4117): stdout: | (launched: 2022-12-09_19:05:32.680347) 19:05:33.932052 run osmo-msc_10.42.42.6(pid=4117): stderr: | [0;m[38;5;43m20221209190533000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190533000 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff19b9b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190533000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190533000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190533000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190533000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190533002 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:33.984135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4110): Terminating (SIGTERM) 19:05:34.026355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4113): Terminating (SIGTERM) 19:05:34.068413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4116): Terminating (SIGTERM) 19:05:34.110862 --- ParallelTerminationStrategy: PID 4110 died... 19:05:34.130632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4110): Terminated: ok {rc=0} 19:05:34.177404 --- ParallelTerminationStrategy: PID 4113 died... 19:05:34.196829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4113): Terminated: ok {rc=0} 19:05:34.243572 --- ParallelTerminationStrategy: PID 4116 died... 19:05:34.263057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4116): Terminated: ok {rc=0} 19:05:34.351141 bus /sierra_3: Setting Powered False 19:05:35.450047 bus /sierra_3: Setting Powered False 19:05:36.566461 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:05:37.709459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:37.721187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:05:37.790913 tst mo_mt_call_osmux.py: using LAC 23087 19:05:37.919840 tst mo_mt_call_osmux.py: using RAC 137 19:05:38.048933 tst mo_mt_call_osmux.py: using CellId 23087 19:05:38.179752 tst mo_mt_call_osmux.py: using BVCI 23088 19:05:38.299905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:38.311872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:38.323679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:38.335789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:38.347550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:05:38.359200 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:05:38.475758 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:05:38.597591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:39.072085 run create_hlr_db(pid=4119): Launched 19:05:39.196298 bus /sierra_2: Setting Powered False 19:05:40.257470 run create_hlr_db(pid=4119): Terminated: ok {rc=0} 19:05:40.704355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4121): Launched 19:05:41.030692 run osmo-hlr_10.42.42.2(pid=4122): Launched 19:05:41.155027 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:41.721112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4124): Launched 19:05:42.046762 run osmo-stp_10.42.42.5(pid=4125): Launched 19:05:42.170893 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:42.760810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4127): Launched 19:05:43.087613 run osmo-msc_10.42.42.6(pid=4128): Launched 19:05:43.268457 run osmo-stp_10.42.42.5(pid=4125): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4125)] 19:05:43.405743 run osmo-stp_10.42.42.5(pid=4125): stdout: | (launched: 2022-12-09_19:05:41.987469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:43.544043 run osmo-stp_10.42.42.5(pid=4125): stderr: | [0;m[38;5;43m20221209190542178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190542178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190542179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190542179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190542179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190542180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190542180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:43.680228 run osmo-stp_10.42.42.5(pid=4125): stdout: | (launched: 2022-12-09_19:05:41.987469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:43.810275 run osmo-stp_10.42.42.5(pid=4125): stderr: | [0;m[38;5;43m20221209190542178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190542178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190542179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190542179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190542179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190542180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190542180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:43.965755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4125): Process ended prematurely: osmo-stp_10.42.42.5(pid=4125) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4125)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:05:43.975780 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:05:44.004283 run osmo-hlr_10.42.42.2(pid=4122): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4122)] 19:05:44.054681 run osmo-hlr_10.42.42.2(pid=4122): stdout: | (launched: 2022-12-09_19:05:40.971389) 19:05:44.106442 run osmo-hlr_10.42.42.2(pid=4122): stderr: | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190541167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190541180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190541188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190541189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190541189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:44.178083 run osmo-msc_10.42.42.6(pid=4128): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4128)] 19:05:44.227972 run osmo-msc_10.42.42.6(pid=4128): stdout: | (launched: 2022-12-09_19:05:43.027687) 19:05:44.279624 run osmo-msc_10.42.42.6(pid=4128): stderr: | [0;m[38;5;43m20221209190543347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190543347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce0a1f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190543347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190543347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190543347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190543347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190543349 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190543350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190543350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190543350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:44.331505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4121): Terminating (SIGTERM) 19:05:44.373501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4124): Terminating (SIGTERM) 19:05:44.415387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4127): Terminating (SIGTERM) 19:05:44.457914 --- ParallelTerminationStrategy: PID 4121 died... 19:05:44.477679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4121): Terminated: ok {rc=0} 19:05:44.524395 --- ParallelTerminationStrategy: PID 4124 died... 19:05:44.543940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4124): Terminated: ok {rc=0} 19:05:44.590410 --- ParallelTerminationStrategy: PID 4127 died... 19:05:44.609822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4127): Terminated: ok {rc=0} 19:05:44.697430 bus /sierra_3: Setting Powered False 19:05:45.794652 bus /sierra_3: Setting Powered False 19:05:46.913243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:05:48.170434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:48.177699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:05:48.213653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:05:48.241225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:05:48.295269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:05:48.330732 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:05:48.358726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:05:48.908343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:05:48.961790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:48.973634 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:05:49.045667 tst mo_mt_call.py: using LAC 23088 19:05:49.166670 tst mo_mt_call.py: using RAC 138 19:05:49.287693 tst mo_mt_call.py: using CellId 23088 19:05:49.408685 tst mo_mt_call.py: using BVCI 23089 19:05:49.520086 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:49.531244 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:49.542193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:49.553182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:49.564117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:49.575005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:05:49.693576 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:05:49.808684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:50.279663 run create_hlr_db(pid=4133): Launched 19:05:50.403139 bus /sierra_2: Setting Powered False 19:05:51.463708 run create_hlr_db(pid=4133): Terminated: ok {rc=0} 19:05:51.909243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4135): Launched 19:05:52.235191 run osmo-hlr_10.42.42.2(pid=4136): Launched 19:05:52.359238 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:52.920762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4138): Launched 19:05:53.246126 run osmo-stp_10.42.42.5(pid=4139): Launched 19:05:53.371395 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:53.964790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4141): Launched 19:05:54.289717 run osmo-msc_10.42.42.6(pid=4142): Launched 19:05:54.472621 run osmo-stp_10.42.42.5(pid=4139): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4139)] 19:05:54.609664 run osmo-stp_10.42.42.5(pid=4139): stdout: | (launched: 2022-12-09_19:05:53.186653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:54.747527 run osmo-stp_10.42.42.5(pid=4139): stderr: | [0;m[38;5;43m20221209190553377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190553377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190553378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190553378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:54.883352 run osmo-stp_10.42.42.5(pid=4139): stdout: | (launched: 2022-12-09_19:05:53.186653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:55.013042 run osmo-stp_10.42.42.5(pid=4139): stderr: | [0;m[38;5;43m20221209190553377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190553377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190553378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190553378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:55.168645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4139): Process ended prematurely: osmo-stp_10.42.42.5(pid=4139) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4139)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:05:55.178549 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:05:55.206639 run osmo-hlr_10.42.42.2(pid=4136): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4136)] 19:05:55.256774 run osmo-hlr_10.42.42.2(pid=4136): stdout: | (launched: 2022-12-09_19:05:52.175585) 19:05:55.308408 run osmo-hlr_10.42.42.2(pid=4136): stderr: | [0;m[1;31m20221209190552372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190552372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190552372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190552373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190552373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190552373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190552385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190552393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190552393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190552393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:55.380176 run osmo-msc_10.42.42.6(pid=4142): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4142)] 19:05:55.429951 run osmo-msc_10.42.42.6(pid=4142): stdout: | (launched: 2022-12-09_19:05:54.230309) 19:05:55.481909 run osmo-msc_10.42.42.6(pid=4142): stderr: | [0;m[38;5;43m20221209190554550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190554550 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f743e9cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190554550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190554550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190554551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190554551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190554552 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190554553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190554553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190554553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:55.534140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4135): Terminating (SIGTERM) 19:05:55.575484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4138): Terminating (SIGTERM) 19:05:55.616808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4141): Terminating (SIGTERM) 19:05:55.659080 --- ParallelTerminationStrategy: PID 4135 died... 19:05:55.678831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4135): Terminated: ok {rc=0} 19:05:55.724902 --- ParallelTerminationStrategy: PID 4138 died... 19:05:55.744271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4138): Terminated: ok {rc=0} 19:05:55.790280 --- ParallelTerminationStrategy: PID 4141 died... 19:05:55.809670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4141): Terminated: ok {rc=0} 19:05:55.897139 bus /sierra_3: Setting Powered False 19:05:56.995433 bus /sierra_3: Setting Powered False 19:05:58.110249 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:05:59.259795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.272346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:05:59.345070 tst mo_mt_call_osmux.py: using LAC 23089 19:05:59.474080 tst mo_mt_call_osmux.py: using RAC 139 19:05:59.603134 tst mo_mt_call_osmux.py: using CellId 23089 19:05:59.729995 tst mo_mt_call_osmux.py: using BVCI 23090 19:05:59.848275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.860166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.871638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.883303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.895126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:05:59.906878 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:06:00.022929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:06:00.143971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:00.650837 run create_hlr_db(pid=4144): Launched 19:06:00.774597 bus /sierra_2: Setting Powered False 19:06:01.850122 run create_hlr_db(pid=4144): Terminated: ok {rc=0} 19:06:02.392637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4146): Launched 19:06:02.719982 run osmo-hlr_10.42.42.2(pid=4147): Launched 19:06:02.843987 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:03.408577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4149): Launched 19:06:03.735816 run osmo-stp_10.42.42.5(pid=4150): Launched 19:06:03.860435 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:04.450315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4152): Launched 19:06:04.778591 run osmo-msc_10.42.42.6(pid=4153): Launched 19:06:04.962128 run osmo-stp_10.42.42.5(pid=4150): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4150)] 19:06:05.099742 run osmo-stp_10.42.42.5(pid=4150): stdout: | (launched: 2022-12-09_19:06:03.676252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:05.237883 run osmo-stp_10.42.42.5(pid=4150): stderr: | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190603869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:05.374776 run osmo-stp_10.42.42.5(pid=4150): stdout: | (launched: 2022-12-09_19:06:03.676252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:05.505280 run osmo-stp_10.42.42.5(pid=4150): stderr: | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190603868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190603869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190603869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:05.661333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4150): Process ended prematurely: osmo-stp_10.42.42.5(pid=4150) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4150)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:06:05.672028 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:06:05.700405 run osmo-hlr_10.42.42.2(pid=4147): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4147)] 19:06:05.750471 run osmo-hlr_10.42.42.2(pid=4147): stdout: | (launched: 2022-12-09_19:06:02.660436) 19:06:05.801769 run osmo-hlr_10.42.42.2(pid=4147): stderr: | [0;m[1;31m20221209190602856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190602857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190602857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190602857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190602857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190602857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190602869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190602877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190602877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190602877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:05.873377 run osmo-msc_10.42.42.6(pid=4153): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4153)] 19:06:05.923031 run osmo-msc_10.42.42.6(pid=4153): stdout: | (launched: 2022-12-09_19:06:04.718921) 19:06:05.974231 run osmo-msc_10.42.42.6(pid=4153): stderr: | [0;m[38;5;43m20221209190605039 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190605039 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5f1ee2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190605039 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190605039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190605039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190605040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190605041 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190605042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190605042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190605042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:06.025868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4146): Terminating (SIGTERM) 19:06:06.067351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4149): Terminating (SIGTERM) 19:06:06.109262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4152): Terminating (SIGTERM) 19:06:06.151011 --- ParallelTerminationStrategy: PID 4146 died... 19:06:06.170802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4146): Terminated: ok {rc=0} 19:06:06.216928 --- ParallelTerminationStrategy: PID 4149 died... 19:06:06.236638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4149): Terminated: ok {rc=0} 19:06:06.282613 --- ParallelTerminationStrategy: PID 4152 died... 19:06:06.302040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4152): Terminated: ok {rc=0} 19:06:06.389876 bus /sierra_3: Setting Powered False 19:06:07.486228 bus /sierra_3: Setting Powered False 19:06:08.598663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:06:09.847367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:09.853975 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:06:09.887454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:06:09.913757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:06:09.965789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:06:10.000619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:06:10.027136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:06:10.576550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:06:10.625787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:10.637189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:06:10.706091 tst mo_mt_call.py: using LAC 23090 19:06:10.824928 tst mo_mt_call.py: using RAC 140 19:06:10.945022 tst mo_mt_call.py: using CellId 23090 19:06:11.064421 tst mo_mt_call.py: using BVCI 23091 19:06:11.174285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:11.185487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:11.196401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:11.207472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:11.218635 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:11.229771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:06:11.349735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:06:11.469087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:11.963171 run create_hlr_db(pid=4158): Launched 19:06:12.088907 bus /sierra_2: Setting Powered False 19:06:13.153936 run create_hlr_db(pid=4158): Terminated: ok {rc=0} 19:06:13.591130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Launched 19:06:13.896848 run osmo-hlr_10.42.42.2(pid=4161): Launched 19:06:14.013234 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:14.539280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Launched 19:06:14.844539 run osmo-stp_10.42.42.5(pid=4164): Launched 19:06:14.966357 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:15.518214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Launched 19:06:15.832071 run osmo-msc_10.42.42.6(pid=4167): Launched 19:06:16.129116 run osmo-stp_10.42.42.5(pid=4164): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] 19:06:16.451828 run osmo-stp_10.42.42.5(pid=4164): stdout: | (launched: 2022-12-09_19:06:14.788304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:16.785591 run osmo-stp_10.42.42.5(pid=4164): stderr: | [0;m[38;5;43m20221209190614957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190614957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190614958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190614958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:17.075271 run osmo-stp_10.42.42.5(pid=4164): stdout: | (launched: 2022-12-09_19:06:14.788304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:17.199675 run osmo-stp_10.42.42.5(pid=4164): stderr: | [0;m[38;5;43m20221209190614957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190614957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190614958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190614958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190614959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:17.347860 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4164): Process ended prematurely: osmo-stp_10.42.42.5(pid=4164) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:06:17.357423 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 19:06:17.384168 run osmo-hlr_10.42.42.2(pid=4161): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4161)] 19:06:17.432321 run osmo-hlr_10.42.42.2(pid=4161): stdout: | (launched: 2022-12-09_19:06:13.841095) 19:06:17.481482 run osmo-hlr_10.42.42.2(pid=4161): stderr: | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190614015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190614027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190614035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190614036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190614036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:17.549953 run osmo-msc_10.42.42.6(pid=4167): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4167)] 19:06:17.597579 run osmo-msc_10.42.42.6(pid=4167): stdout: | (launched: 2022-12-09_19:06:15.767296) 19:06:17.646497 run osmo-msc_10.42.42.6(pid=4167): stderr: | [0;m[38;5;43m20221209190616494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190616496 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2450477c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190616497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190616497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190616498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190616500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190616503 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190616503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190616503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190616503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:17.695803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Terminating (SIGTERM) 19:06:17.735284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Terminating (SIGTERM) 19:06:17.774834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Terminating (SIGTERM) 19:06:17.814744 --- ParallelTerminationStrategy: PID 4160 died... 19:06:17.833795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Terminated: ok {rc=0} 19:06:17.877725 --- ParallelTerminationStrategy: PID 4163 died... 19:06:17.896260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Terminated: ok {rc=0} 19:06:17.939900 --- ParallelTerminationStrategy: PID 4166 died... 19:06:17.958474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Terminated: ok {rc=0} 19:06:18.043725 bus /sierra_3: Setting Powered False 19:06:19.144544 bus /sierra_3: Setting Powered False 19:06:20.261900 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:06:21.409263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:21.421253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:06:21.490470 tst mo_mt_call_osmux.py: using LAC 23091 19:06:21.618929 tst mo_mt_call_osmux.py: using RAC 141 19:06:21.747848 tst mo_mt_call_osmux.py: using CellId 23091 19:06:21.875540 tst mo_mt_call_osmux.py: using BVCI 23092 19:06:21.995384 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:22.007386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:22.019102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:22.031171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:22.043405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:06:22.055504 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:06:22.172621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:06:22.287765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:22.762805 run create_hlr_db(pid=4169): Launched 19:06:22.888322 bus /sierra_2: Setting Powered False 19:06:23.950443 run create_hlr_db(pid=4169): Terminated: ok {rc=0} 19:06:24.397676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Launched 19:06:24.727170 run osmo-hlr_10.42.42.2(pid=4172): Launched 19:06:24.852091 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:25.417471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Launched 19:06:25.745479 run osmo-stp_10.42.42.5(pid=4175): Launched 19:06:25.871114 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:26.462066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4177): Launched 19:06:26.790169 run osmo-msc_10.42.42.6(pid=4178): Launched 19:06:26.973493 run osmo-stp_10.42.42.5(pid=4175): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] 19:06:27.111485 run osmo-stp_10.42.42.5(pid=4175): stdout: | (launched: 2022-12-09_19:06:25.685747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:27.250041 run osmo-stp_10.42.42.5(pid=4175): stderr: | [0;m[38;5;43m20221209190625877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190625878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190625878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190625878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:27.386822 run osmo-stp_10.42.42.5(pid=4175): stdout: | (launched: 2022-12-09_19:06:25.685747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:27.518247 run osmo-stp_10.42.42.5(pid=4175): stderr: | [0;m[38;5;43m20221209190625877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190625878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190625878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190625878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190625879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:27.675019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4175): Process ended prematurely: osmo-stp_10.42.42.5(pid=4175) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:06:27.685084 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:06:27.713776 run osmo-hlr_10.42.42.2(pid=4172): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4172)] 19:06:27.764218 run osmo-hlr_10.42.42.2(pid=4172): stdout: | (launched: 2022-12-09_19:06:24.667292) 19:06:27.816181 run osmo-hlr_10.42.42.2(pid=4172): stderr: | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190624864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190624878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190624886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190624887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190624887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:27.888330 run osmo-msc_10.42.42.6(pid=4178): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4178)] 19:06:27.938464 run osmo-msc_10.42.42.6(pid=4178): stdout: | (launched: 2022-12-09_19:06:26.730520) 19:06:27.990236 run osmo-msc_10.42.42.6(pid=4178): stderr: | [0;m[38;5;43m20221209190627049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190627050 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe83b3fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190627050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190627050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190627050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190627050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190627052 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190627052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190627052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190627052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:28.042468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Terminating (SIGTERM) 19:06:28.084425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Terminating (SIGTERM) 19:06:28.126533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4177): Terminating (SIGTERM) 19:06:28.168852 --- ParallelTerminationStrategy: PID 4171 died... 19:06:28.188702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Terminated: ok {rc=0} 19:06:28.235385 --- ParallelTerminationStrategy: PID 4174 died... 19:06:28.254881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Terminated: ok {rc=0} 19:06:28.301232 --- ParallelTerminationStrategy: PID 4177 died... 19:06:28.320475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4177): Terminated: ok {rc=0} 19:06:28.407601 bus /sierra_3: Setting Powered False 19:06:29.503365 bus /sierra_3: Setting Powered False 19:06:30.617130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:06:31.875549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:31.885135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:06:31.923548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:06:31.952893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:06:32.010859 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:06:32.047439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:06:32.076685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:06:32.627291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:06:32.681246 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:32.692919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:06:32.762779 tst mo_mt_call.py: using LAC 23092 19:06:32.888498 tst mo_mt_call.py: using RAC 142 19:06:33.014225 tst mo_mt_call.py: using CellId 23092 19:06:33.140345 tst mo_mt_call.py: using BVCI 23093 19:06:33.258737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:33.270340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:33.281781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:33.293369 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:33.305063 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:33.316632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:06:33.432156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:06:33.551919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:34.058318 run create_hlr_db(pid=4184): Launched 19:06:34.184138 bus /sierra_2: Setting Powered False 19:06:35.249329 run create_hlr_db(pid=4184): Terminated: ok {rc=0} 19:06:35.687361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4187): Launched 19:06:35.991477 run osmo-hlr_10.42.42.2(pid=4188): Launched 19:06:36.107104 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:36.632080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4190): Launched 19:06:36.936892 run osmo-stp_10.42.42.5(pid=4191): Launched 19:06:37.052386 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:37.605606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4193): Launched 19:06:37.911118 run osmo-msc_10.42.42.6(pid=4194): Launched 19:06:38.081170 run osmo-stp_10.42.42.5(pid=4191): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4191)] 19:06:38.210148 run osmo-stp_10.42.42.5(pid=4191): stdout: | (launched: 2022-12-09_19:06:36.881262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:38.339028 run osmo-stp_10.42.42.5(pid=4191): stderr: | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190637049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:38.466147 run osmo-stp_10.42.42.5(pid=4191): stdout: | (launched: 2022-12-09_19:06:36.881262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:38.587609 run osmo-stp_10.42.42.5(pid=4191): stderr: | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190637049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190637049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:38.732502 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4191): Process ended prematurely: osmo-stp_10.42.42.5(pid=4191) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4191)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:06:38.741621 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:06:38.767697 run osmo-hlr_10.42.42.2(pid=4188): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4188)] 19:06:38.815473 run osmo-hlr_10.42.42.2(pid=4188): stdout: | (launched: 2022-12-09_19:06:35.935686) 19:06:38.864248 run osmo-hlr_10.42.42.2(pid=4188): stderr: | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190636110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190636122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190636131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190636131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190636131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:38.932549 run osmo-msc_10.42.42.6(pid=4194): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4194)] 19:06:38.979560 run osmo-msc_10.42.42.6(pid=4194): stdout: | (launched: 2022-12-09_19:06:37.855092) 19:06:39.028454 run osmo-msc_10.42.42.6(pid=4194): stderr: | [0;m[38;5;43m20221209190638127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190638127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f338c010c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190638128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190638128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190638128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190638128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190638130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190638130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190638131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190638131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:39.077415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4187): Terminating (SIGTERM) 19:06:39.117329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4190): Terminating (SIGTERM) 19:06:39.156647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4193): Terminating (SIGTERM) 19:06:39.196182 --- ParallelTerminationStrategy: PID 4187 died... 19:06:39.215023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4187): Terminated: ok {rc=0} 19:06:39.258491 --- ParallelTerminationStrategy: PID 4190 died... 19:06:39.277110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4190): Terminated: ok {rc=0} 19:06:39.320512 --- ParallelTerminationStrategy: PID 4193 died... 19:06:39.338813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4193): Terminated: ok {rc=0} 19:06:39.423743 bus /sierra_3: Setting Powered False 19:06:40.523643 bus /sierra_3: Setting Powered False 19:06:41.639593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:06:42.786665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:42.798549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:06:42.869482 tst mo_mt_call_osmux.py: using LAC 23093 19:06:42.990029 tst mo_mt_call_osmux.py: using RAC 143 19:06:43.109807 tst mo_mt_call_osmux.py: using CellId 23093 19:06:43.238849 tst mo_mt_call_osmux.py: using BVCI 23094 19:06:43.358809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:43.370617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:43.382319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:43.394276 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:43.406243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:06:43.418109 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:06:43.533321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:06:43.653466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:44.160820 run create_hlr_db(pid=4196): Launched 19:06:44.286212 bus /sierra_2: Setting Powered False 19:06:45.351969 run create_hlr_db(pid=4196): Terminated: ok {rc=0} 19:06:45.790708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Launched 19:06:46.145977 run osmo-hlr_10.42.42.2(pid=4199): Launched 19:06:46.404894 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:46.990350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Launched 19:06:47.315130 run osmo-stp_10.42.42.5(pid=4202): Launched 19:06:47.431524 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:47.984572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4204): Launched 19:06:48.293708 run osmo-msc_10.42.42.6(pid=4205): Launched 19:06:48.477987 run osmo-stp_10.42.42.5(pid=4202): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] 19:06:48.617698 run osmo-stp_10.42.42.5(pid=4202): stdout: | (launched: 2022-12-09_19:06:47.258331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:48.760276 run osmo-stp_10.42.42.5(pid=4202): stderr: | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190647428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:48.897462 run osmo-stp_10.42.42.5(pid=4202): stdout: | (launched: 2022-12-09_19:06:47.258331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:49.028893 run osmo-stp_10.42.42.5(pid=4202): stderr: | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190647427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190647428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190647428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:49.186365 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4202): Process ended prematurely: osmo-stp_10.42.42.5(pid=4202) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:06:49.196255 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:06:49.225077 run osmo-hlr_10.42.42.2(pid=4199): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4199)] 19:06:49.275438 run osmo-hlr_10.42.42.2(pid=4199): stdout: | (launched: 2022-12-09_19:06:46.078823) 19:06:49.327303 run osmo-hlr_10.42.42.2(pid=4199): stderr: | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190646302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190646330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190646338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190646339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190646339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:49.399667 run osmo-msc_10.42.42.6(pid=4205): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4205)] 19:06:49.449786 run osmo-msc_10.42.42.6(pid=4205): stdout: | (launched: 2022-12-09_19:06:48.233866) 19:06:49.501587 run osmo-msc_10.42.42.6(pid=4205): stderr: | [0;m[38;5;43m20221209190648556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190648556 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07c469dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190648556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190648556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190648556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190648556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190648558 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190648559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190648559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190648559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:49.553772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Terminating (SIGTERM) 19:06:49.595683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Terminating (SIGTERM) 19:06:49.637669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4204): Terminating (SIGTERM) 19:06:49.679785 --- ParallelTerminationStrategy: PID 4198 died... 19:06:49.699559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Terminated: ok {rc=0} 19:06:49.746005 --- ParallelTerminationStrategy: PID 4201 died... 19:06:49.765537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Terminated: ok {rc=0} 19:06:49.811869 --- ParallelTerminationStrategy: PID 4204 died... 19:06:49.831459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4204): Terminated: ok {rc=0} 19:06:49.919105 bus /sierra_3: Setting Powered False 19:06:51.016131 bus /sierra_3: Setting Powered False 19:06:52.131095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:06:53.384371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:53.391591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:06:53.427210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:06:53.454901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:06:53.508118 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:06:53.542771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:06:53.569974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:06:54.122889 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:06:54.175782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.187544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:06:54.259463 tst mo_mt_call.py: using LAC 23094 19:06:54.388322 tst mo_mt_call.py: using RAC 144 19:06:54.517747 tst mo_mt_call.py: using CellId 23094 19:06:54.646563 tst mo_mt_call.py: using BVCI 23095 19:06:54.764916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.776599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.788097 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.799887 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.811902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:06:54.823791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:06:54.942058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:06:55.063219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:55.541066 run create_hlr_db(pid=4210): Launched 19:06:55.666557 bus /sierra_2: Setting Powered False 19:06:56.726467 run create_hlr_db(pid=4210): Terminated: ok {rc=0} 19:06:57.174227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4212): Launched 19:06:57.501968 run osmo-hlr_10.42.42.2(pid=4213): Launched 19:06:57.629261 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:58.191217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4215): Launched 19:06:58.519648 run osmo-stp_10.42.42.5(pid=4216): Launched 19:06:58.646585 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:59.241237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4218): Launched 19:06:59.569205 run osmo-msc_10.42.42.6(pid=4219): Launched 19:06:59.751530 run osmo-stp_10.42.42.5(pid=4216): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4216)] 19:06:59.889545 run osmo-stp_10.42.42.5(pid=4216): stdout: | (launched: 2022-12-09_19:06:58.459559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:00.026789 run osmo-stp_10.42.42.5(pid=4216): stderr: | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190658651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:00.163358 run osmo-stp_10.42.42.5(pid=4216): stdout: | (launched: 2022-12-09_19:06:58.459559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:00.293798 run osmo-stp_10.42.42.5(pid=4216): stderr: | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190658651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190658651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190658652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:00.450096 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4216): Process ended prematurely: osmo-stp_10.42.42.5(pid=4216) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4216)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:07:00.459887 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:07:00.488515 run osmo-hlr_10.42.42.2(pid=4213): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4213)] 19:07:00.538720 run osmo-hlr_10.42.42.2(pid=4213): stdout: | (launched: 2022-12-09_19:06:57.442021) 19:07:00.590422 run osmo-hlr_10.42.42.2(pid=4213): stderr: | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190657639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190657652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190657662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190657663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190657663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:00.662671 run osmo-msc_10.42.42.6(pid=4219): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4219)] 19:07:00.712713 run osmo-msc_10.42.42.6(pid=4219): stdout: | (launched: 2022-12-09_19:06:59.508887) 19:07:00.764370 run osmo-msc_10.42.42.6(pid=4219): stderr: | [0;m[38;5;43m20221209190659830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190659830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1561a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190659830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190659830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190659830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190659831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190659832 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190659833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190659833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190659833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:00.819565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4212): Terminating (SIGTERM) 19:07:00.866421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4215): Terminating (SIGTERM) 19:07:00.927271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4218): Terminating (SIGTERM) 19:07:00.971381 --- ParallelTerminationStrategy: PID 4212 died... 19:07:00.991125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4212): Terminated: ok {rc=0} 19:07:01.038174 --- ParallelTerminationStrategy: PID 4215 died... 19:07:01.057747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4215): Terminated: ok {rc=0} 19:07:01.106026 --- ParallelTerminationStrategy: PID 4218 died... 19:07:01.125456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4218): Terminated: ok {rc=0} 19:07:01.213261 bus /sierra_3: Setting Powered False 19:07:02.311508 bus /sierra_3: Setting Powered False 19:07:03.425894 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:07:04.574966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:04.587484 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:07:04.660452 tst mo_mt_call_osmux.py: using LAC 23095 19:07:04.795500 tst mo_mt_call_osmux.py: using RAC 145 19:07:04.916756 tst mo_mt_call_osmux.py: using CellId 23095 19:07:05.035979 tst mo_mt_call_osmux.py: using BVCI 23096 19:07:05.147094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:05.158528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:05.169926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:05.181638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:05.193586 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:07:05.204911 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:07:05.321120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:07:05.443135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:05.952844 run create_hlr_db(pid=4221): Launched 19:07:06.077945 bus /sierra_2: Setting Powered False 19:07:07.142541 run create_hlr_db(pid=4221): Terminated: ok {rc=0} 19:07:07.582306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Launched 19:07:07.891036 run osmo-hlr_10.42.42.2(pid=4224): Launched 19:07:08.007359 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:08.545600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Launched 19:07:08.852293 run osmo-stp_10.42.42.5(pid=4227): Launched 19:07:08.968636 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:09.523002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4229): Launched 19:07:09.831701 run osmo-msc_10.42.42.6(pid=4230): Launched 19:07:10.002678 run osmo-stp_10.42.42.5(pid=4227): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] 19:07:10.131804 run osmo-stp_10.42.42.5(pid=4227): stdout: | (launched: 2022-12-09_19:07:08.795391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:10.260465 run osmo-stp_10.42.42.5(pid=4227): stderr: | [0;m[38;5;43m20221209190708964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190708965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190708965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190708965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:10.387650 run osmo-stp_10.42.42.5(pid=4227): stdout: | (launched: 2022-12-09_19:07:08.795391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:10.509432 run osmo-stp_10.42.42.5(pid=4227): stderr: | [0;m[38;5;43m20221209190708964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190708965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190708965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190708965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190708966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:10.655296 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4227): Process ended prematurely: osmo-stp_10.42.42.5(pid=4227) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:07:10.664360 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:07:10.690494 run osmo-hlr_10.42.42.2(pid=4224): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4224)] 19:07:10.737601 run osmo-hlr_10.42.42.2(pid=4224): stdout: | (launched: 2022-12-09_19:07:07.834963) 19:07:10.785915 run osmo-hlr_10.42.42.2(pid=4224): stderr: | [0;m[1;31m20221209190708008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190708008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190708008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190708009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190708009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190708009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190708021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190708029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190708029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190708029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:10.853592 run osmo-msc_10.42.42.6(pid=4230): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4230)] 19:07:10.900399 run osmo-msc_10.42.42.6(pid=4230): stdout: | (launched: 2022-12-09_19:07:09.775285) 19:07:10.948481 run osmo-msc_10.42.42.6(pid=4230): stderr: | [0;m[38;5;43m20221209190710049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190710050 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6916a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190710050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190710050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190710050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190710050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190710052 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190710053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190710053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190710053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:10.997290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Terminating (SIGTERM) 19:07:11.036087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Terminating (SIGTERM) 19:07:11.074906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4229): Terminating (SIGTERM) 19:07:11.114138 --- ParallelTerminationStrategy: PID 4223 died... 19:07:11.132766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Terminated: ok {rc=0} 19:07:11.176342 --- ParallelTerminationStrategy: PID 4226 died... 19:07:11.194698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Terminated: ok {rc=0} 19:07:11.237764 --- ParallelTerminationStrategy: PID 4229 died... 19:07:11.256038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4229): Terminated: ok {rc=0} 19:07:11.340325 bus /sierra_3: Setting Powered False 19:07:12.439508 bus /sierra_3: Setting Powered False 19:07:13.551155 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:07:14.809903 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:14.816238 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:07:14.849380 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:07:14.875335 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:07:14.926838 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:07:14.962719 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:07:14.990200 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:07:15.538208 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:07:15.587362 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:15.598541 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:07:15.667174 tst mo_mt_call.py: using LAC 23096 19:07:15.786034 tst mo_mt_call.py: using RAC 146 19:07:15.939541 tst mo_mt_call.py: using CellId 23096 19:07:16.069746 tst mo_mt_call.py: using BVCI 23097 19:07:16.198814 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:16.213449 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:16.228854 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:16.243037 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:16.258003 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:16.271666 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:07:16.396940 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:07:16.544693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:17.023793 run create_hlr_db(pid=4235): Launched 19:07:17.182850 bus /sierra_2: Setting Powered False 19:07:18.243024 run create_hlr_db(pid=4235): Terminated: ok {rc=0} 19:07:18.668385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4237): Launched 19:07:18.973010 run osmo-hlr_10.42.42.2(pid=4238): Launched 19:07:19.088150 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:19.617134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4240): Launched 19:07:19.922043 run osmo-stp_10.42.42.5(pid=4241): Launched 19:07:20.036406 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:20.587485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4243): Launched 19:07:20.894114 run osmo-msc_10.42.42.6(pid=4244): Launched 19:07:21.063857 run osmo-stp_10.42.42.5(pid=4241): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4241)] 19:07:21.192220 run osmo-stp_10.42.42.5(pid=4241): stdout: | (launched: 2022-12-09_19:07:19.865340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:21.320561 run osmo-stp_10.42.42.5(pid=4241): stderr: | [0;m[38;5;43m20221209190720033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190720033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190720034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190720034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190720034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190720034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190720035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:21.448017 run osmo-stp_10.42.42.5(pid=4241): stdout: | (launched: 2022-12-09_19:07:19.865340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:21.569659 run osmo-stp_10.42.42.5(pid=4241): stderr: | [0;m[38;5;43m20221209190720033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190720033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190720034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190720034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190720034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190720034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190720035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:21.715089 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4241): Process ended prematurely: osmo-stp_10.42.42.5(pid=4241) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4241)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:07:21.723953 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:07:21.750006 run osmo-hlr_10.42.42.2(pid=4238): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4238)] 19:07:21.797154 run osmo-hlr_10.42.42.2(pid=4238): stdout: | (launched: 2022-12-09_19:07:18.917057) 19:07:21.845888 run osmo-hlr_10.42.42.2(pid=4238): stderr: | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190719092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190719104 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190719114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190719114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190719114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:21.914328 run osmo-msc_10.42.42.6(pid=4244): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4244)] 19:07:21.961491 run osmo-msc_10.42.42.6(pid=4244): stdout: | (launched: 2022-12-09_19:07:20.836701) 19:07:22.009906 run osmo-msc_10.42.42.6(pid=4244): stderr: | [0;m[38;5;43m20221209190721109 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190721109 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1602c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190721109 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190721109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190721109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190721109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190721111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190721111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190721112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190721112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:22.058807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4237): Terminating (SIGTERM) 19:07:22.098016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4240): Terminating (SIGTERM) 19:07:22.137276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4243): Terminating (SIGTERM) 19:07:22.176678 --- ParallelTerminationStrategy: PID 4237 died... 19:07:22.195405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4237): Terminated: ok {rc=0} 19:07:22.238910 --- ParallelTerminationStrategy: PID 4240 died... 19:07:22.257187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4240): Terminated: ok {rc=0} 19:07:22.300352 --- ParallelTerminationStrategy: PID 4243 died... 19:07:22.318694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4243): Terminated: ok {rc=0} 19:07:22.403541 bus /sierra_3: Setting Powered False 19:07:23.503354 bus /sierra_3: Setting Powered False 19:07:24.618676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:07:25.762344 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:25.774149 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:07:25.850918 tst mo_mt_call_osmux.py: using LAC 23097 19:07:25.980237 tst mo_mt_call_osmux.py: using RAC 147 19:07:26.107463 tst mo_mt_call_osmux.py: using CellId 23097 19:07:26.234667 tst mo_mt_call_osmux.py: using BVCI 23098 19:07:26.353093 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:26.365051 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:26.376611 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:26.388280 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:26.400114 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:07:26.411756 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:07:26.527530 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:07:26.647265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:27.154928 run create_hlr_db(pid=4246): Launched 19:07:27.281894 bus /sierra_2: Setting Powered False 19:07:28.346589 run create_hlr_db(pid=4246): Terminated: ok {rc=0} 19:07:28.801374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4248): Launched 19:07:29.127693 run osmo-hlr_10.42.42.2(pid=4249): Launched 19:07:29.252899 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:29.824731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4251): Launched 19:07:30.151253 run osmo-stp_10.42.42.5(pid=4252): Launched 19:07:30.277528 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:30.882788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4254): Launched 19:07:31.208538 run osmo-msc_10.42.42.6(pid=4255): Launched 19:07:31.475209 run osmo-stp_10.42.42.5(pid=4252): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4252)] 19:07:31.632840 run osmo-stp_10.42.42.5(pid=4252): stdout: | (launched: 2022-12-09_19:07:30.091647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:31.903212 run osmo-stp_10.42.42.5(pid=4252): stderr: | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190730282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:32.187704 run osmo-stp_10.42.42.5(pid=4252): stdout: | (launched: 2022-12-09_19:07:30.091647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:32.349568 run osmo-stp_10.42.42.5(pid=4252): stderr: | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190730281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190730282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190730282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:32.508654 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4252): Process ended prematurely: osmo-stp_10.42.42.5(pid=4252) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4252)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:07:32.518712 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 19:07:32.547459 run osmo-hlr_10.42.42.2(pid=4249): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4249)] 19:07:32.599251 run osmo-hlr_10.42.42.2(pid=4249): stdout: | (launched: 2022-12-09_19:07:29.068074) 19:07:32.651738 run osmo-hlr_10.42.42.2(pid=4249): stderr: | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190729265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190729278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190729287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190729288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190729288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:32.724332 run osmo-msc_10.42.42.6(pid=4255): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4255)] 19:07:32.775032 run osmo-msc_10.42.42.6(pid=4255): stdout: | (launched: 2022-12-09_19:07:31.151001) 19:07:32.827474 run osmo-msc_10.42.42.6(pid=4255): stderr: | [0;m[38;5;43m20221209190731808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190731808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f546e0c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190731808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190731808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190731808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190731809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190731816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190731817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190731818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190731818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:32.880390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4248): Terminating (SIGTERM) 19:07:32.922785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4251): Terminating (SIGTERM) 19:07:32.965022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4254): Terminating (SIGTERM) 19:07:33.007411 --- ParallelTerminationStrategy: PID 4248 died... 19:07:33.027123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4248): Terminated: ok {rc=0} 19:07:33.074617 --- ParallelTerminationStrategy: PID 4251 died... 19:07:33.094109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4251): Terminated: ok {rc=0} 19:07:33.141592 --- ParallelTerminationStrategy: PID 4254 died... 19:07:33.161168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4254): Terminated: ok {rc=0} 19:07:33.250072 bus /sierra_3: Setting Powered False 19:07:34.348521 bus /sierra_3: Setting Powered False 19:07:35.462994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:07:36.719325 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:36.725630 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:07:36.760688 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:07:36.788507 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:07:36.845090 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:07:36.880621 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:07:36.908227 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:07:37.454824 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:07:37.508034 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:37.519724 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:07:37.591362 tst mo_mt_call.py: using LAC 23098 19:07:37.710931 tst mo_mt_call.py: using RAC 148 19:07:37.829565 tst mo_mt_call.py: using CellId 23098 19:07:37.950231 tst mo_mt_call.py: using BVCI 23099 19:07:38.062783 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:38.074019 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:38.085105 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:38.096169 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:38.107206 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:38.118090 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:07:38.236586 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:07:38.355081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:38.828371 run create_hlr_db(pid=4260): Launched 19:07:38.952315 bus /sierra_2: Setting Powered False 19:07:40.013386 run create_hlr_db(pid=4260): Terminated: ok {rc=0} 19:07:40.460845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4262): Launched 19:07:40.791160 run osmo-hlr_10.42.42.2(pid=4263): Launched 19:07:40.915450 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:41.477616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4265): Launched 19:07:41.806872 run osmo-stp_10.42.42.5(pid=4266): Launched 19:07:41.933319 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:42.526693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4268): Launched 19:07:42.854539 run osmo-msc_10.42.42.6(pid=4269): Launched 19:07:43.027921 run osmo-stp_10.42.42.5(pid=4266): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4266)] 19:07:43.160147 run osmo-stp_10.42.42.5(pid=4266): stdout: | (launched: 2022-12-09_19:07:41.747261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:43.290025 run osmo-stp_10.42.42.5(pid=4266): stderr: | [0;m[38;5;43m20221209190741939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190741939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190741940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190741940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190741940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190741941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190741941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:43.418136 run osmo-stp_10.42.42.5(pid=4266): stdout: | (launched: 2022-12-09_19:07:41.747261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:43.540652 run osmo-stp_10.42.42.5(pid=4266): stderr: | [0;m[38;5;43m20221209190741939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190741939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190741940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190741940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190741940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190741941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190741941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:43.688038 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4266): Process ended prematurely: osmo-stp_10.42.42.5(pid=4266) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4266)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:07:43.697283 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:07:43.723582 run osmo-hlr_10.42.42.2(pid=4263): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4263)] 19:07:43.771088 run osmo-hlr_10.42.42.2(pid=4263): stdout: | (launched: 2022-12-09_19:07:40.731669) 19:07:43.820513 run osmo-hlr_10.42.42.2(pid=4263): stderr: | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190740929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190740941 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190740949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190740950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190740950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:43.888878 run osmo-msc_10.42.42.6(pid=4269): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4269)] 19:07:43.936314 run osmo-msc_10.42.42.6(pid=4269): stdout: | (launched: 2022-12-09_19:07:42.794910) 19:07:43.985324 run osmo-msc_10.42.42.6(pid=4269): stderr: | [0;m[38;5;43m20221209190743070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190743070 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe3abc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190743070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190743070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190743070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190743071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190743072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190743073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190743073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190743073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:44.034775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4262): Terminating (SIGTERM) 19:07:44.074061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4265): Terminating (SIGTERM) 19:07:44.113463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4268): Terminating (SIGTERM) 19:07:44.153210 --- ParallelTerminationStrategy: PID 4262 died... 19:07:44.172174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4262): Terminated: ok {rc=0} 19:07:44.216540 --- ParallelTerminationStrategy: PID 4265 died... 19:07:44.235208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4265): Terminated: ok {rc=0} 19:07:44.279027 --- ParallelTerminationStrategy: PID 4268 died... 19:07:44.297835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4268): Terminated: ok {rc=0} 19:07:44.384421 bus /sierra_3: Setting Powered False 19:07:45.484252 bus /sierra_3: Setting Powered False 19:07:46.613540 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:07:47.766720 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:47.778982 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:07:47.852518 tst mo_mt_call_osmux.py: using LAC 23099 19:07:47.974440 tst mo_mt_call_osmux.py: using RAC 149 19:07:48.097054 tst mo_mt_call_osmux.py: using CellId 23099 19:07:48.218453 tst mo_mt_call_osmux.py: using BVCI 23100 19:07:48.331327 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:48.342694 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:48.353821 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:48.364785 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:48.375867 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:07:48.386720 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:07:48.507950 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:07:48.628388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:49.104223 run create_hlr_db(pid=4271): Launched 19:07:49.228644 bus /sierra_2: Setting Powered False 19:07:50.289608 run create_hlr_db(pid=4271): Terminated: ok {rc=0} 19:07:50.718014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Launched 19:07:51.025407 run osmo-hlr_10.42.42.2(pid=4274): Launched 19:07:51.140690 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:51.664592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Launched 19:07:51.971448 run osmo-stp_10.42.42.5(pid=4277): Launched 19:07:52.087591 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:52.638896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4279): Launched 19:07:52.946182 run osmo-msc_10.42.42.6(pid=4280): Launched 19:07:53.115665 run osmo-stp_10.42.42.5(pid=4277): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] 19:07:53.244242 run osmo-stp_10.42.42.5(pid=4277): stdout: | (launched: 2022-12-09_19:07:51.915509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:53.372766 run osmo-stp_10.42.42.5(pid=4277): stderr: | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190752085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:53.499384 run osmo-stp_10.42.42.5(pid=4277): stdout: | (launched: 2022-12-09_19:07:51.915509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:53.620879 run osmo-stp_10.42.42.5(pid=4277): stderr: | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190752084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190752085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190752085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:53.766890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4277): Process ended prematurely: osmo-stp_10.42.42.5(pid=4277) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:07:53.775890 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:07:53.802116 run osmo-hlr_10.42.42.2(pid=4274): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4274)] 19:07:53.849306 run osmo-hlr_10.42.42.2(pid=4274): stdout: | (launched: 2022-12-09_19:07:50.969105) 19:07:53.898352 run osmo-hlr_10.42.42.2(pid=4274): stderr: | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190751146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190751157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190751166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190751166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190751167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:53.966301 run osmo-msc_10.42.42.6(pid=4280): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4280)] 19:07:54.013585 run osmo-msc_10.42.42.6(pid=4280): stdout: | (launched: 2022-12-09_19:07:52.890074) 19:07:54.062182 run osmo-msc_10.42.42.6(pid=4280): stderr: | [0;m[38;5;43m20221209190753161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190753161 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f813b0dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190753161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190753161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190753162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190753162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190753163 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190753164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190753164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190753164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:54.111190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Terminating (SIGTERM) 19:07:54.149981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Terminating (SIGTERM) 19:07:54.189166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4279): Terminating (SIGTERM) 19:07:54.228491 --- ParallelTerminationStrategy: PID 4273 died... 19:07:54.247251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Terminated: ok {rc=0} 19:07:54.290946 --- ParallelTerminationStrategy: PID 4276 died... 19:07:54.309298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Terminated: ok {rc=0} 19:07:54.352638 --- ParallelTerminationStrategy: PID 4279 died... 19:07:54.371059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4279): Terminated: ok {rc=0} 19:07:54.453621 bus /sierra_3: Setting Powered False 19:07:55.550881 bus /sierra_3: Setting Powered False 19:07:56.666766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 19:07:57.920556 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:57.925566 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:07:57.961206 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:07:57.988496 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:07:58.080669 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:07:58.115565 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:07:58.142729 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:07:58.720009 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 19:07:58.726177 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:58.737499 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:07:58.788569 tst emergency_mo_mt_call.py: using LAC 23100 19:07:58.905300 tst emergency_mo_mt_call.py: using RAC 150 19:07:59.024599 tst emergency_mo_mt_call.py: using CellId 23100 19:07:59.141733 tst emergency_mo_mt_call.py: using BVCI 23101 19:07:59.251171 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:59.262191 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:59.272997 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:59.284085 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:59.295266 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:07:59.306483 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:07:59.425773 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:07:59.544591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:00.045652 run create_hlr_db(pid=4285): Launched 19:08:00.168156 bus /sierra_2: Setting Powered False 19:08:01.247895 run create_hlr_db(pid=4285): Terminated: ok {rc=0} 19:08:01.700126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4287): Launched 19:08:02.078321 run osmo-hlr_10.42.42.2(pid=4297): Launched 19:08:02.331918 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:03.031351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4339): Launched 19:08:03.396931 run osmo-stp_10.42.42.5(pid=4369): Launched 19:08:03.696214 tst emergency_mo_mt_call.py: using MSISDN 7333 19:08:03.991047 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:04.664010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4536): Launched 19:08:05.033646 run osmo-msc_10.42.42.6(pid=4563): Launched 19:08:05.282952 run osmo-stp_10.42.42.5(pid=4369): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4369)] 19:08:05.547840 run osmo-stp_10.42.42.5(pid=4369): stdout: | (launched: 2022-12-09_19:08:03.326008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:05.814564 run osmo-stp_10.42.42.5(pid=4369): stderr: | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190803707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:06.036478 run osmo-stp_10.42.42.5(pid=4369): stdout: | (launched: 2022-12-09_19:08:03.326008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:06.158840 run osmo-stp_10.42.42.5(pid=4369): stderr: | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190803706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190803707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190803707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:06.306536 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4369): Process ended prematurely: osmo-stp_10.42.42.5(pid=4369) [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4369)] [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 19:08:06.317333 tst emergency_mo_mt_call.py:19: Test FAILED (7.6 sec) 19:08:06.345532 run osmo-hlr_10.42.42.2(pid=4297): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4297)] 19:08:06.395247 run osmo-hlr_10.42.42.2(pid=4297): stdout: | (launched: 2022-12-09_19:08:02.022408) 19:08:06.446940 run osmo-hlr_10.42.42.2(pid=4297): stderr: | [0;m[1;31m20221209190802379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190802379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190802379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190802380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190802380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190802380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190802403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190802428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190802428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190802428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:06.518367 run osmo-msc_10.42.42.6(pid=4563): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4563)] 19:08:06.568594 run osmo-msc_10.42.42.6(pid=4563): stdout: | (launched: 2022-12-09_19:08:04.977305) 19:08:06.619966 run osmo-msc_10.42.42.6(pid=4563): stderr: | [0;m[38;5;43m20221209190805578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190805578 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f702c409c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190805578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190805578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190805578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190805579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190805580 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190805581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190805581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190805581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:06.671680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4287): Terminating (SIGTERM) 19:08:06.713275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4339): Terminating (SIGTERM) 19:08:06.756749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4536): Terminating (SIGTERM) 19:08:06.800383 --- ParallelTerminationStrategy: PID 4287 died... 19:08:06.821659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4287): Terminated: ok {rc=0} 19:08:06.869677 --- ParallelTerminationStrategy: PID 4339 died... 19:08:06.889369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4339): Terminated: ok {rc=0} 19:08:06.934835 --- ParallelTerminationStrategy: PID 4536 died... 19:08:06.954395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4536): Terminated: ok {rc=0} 19:08:07.039867 bus /sierra_3: Setting Powered False 19:08:08.137922 bus /sierra_3: Setting Powered False 19:08:09.255638 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 19:08:10.348642 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:10.361760 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:08:10.418396 tst emergency_preemptive_call.py: using LAC 23101 19:08:10.555597 tst emergency_preemptive_call.py: using RAC 151 19:08:10.684827 tst emergency_preemptive_call.py: using CellId 23101 19:08:10.815273 tst emergency_preemptive_call.py: using BVCI 23102 19:08:10.937571 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:10.949904 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:10.962106 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:10.975323 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:10.989300 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:08:11.002982 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:11.126347 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:11.251979 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:11.377967 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:11.499317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:12.024422 run create_hlr_db(pid=4567): Launched 19:08:12.190437 bus /sierra_2: Setting Powered False 19:08:13.255713 run create_hlr_db(pid=4567): Terminated: ok {rc=0} 19:08:13.723442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4569): Launched 19:08:14.066139 run osmo-hlr_10.42.42.2(pid=4570): Launched 19:08:14.312907 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:14.989402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4572): Launched 19:08:15.333612 run osmo-stp_10.42.42.5(pid=4573): Launched 19:08:15.590356 tst emergency_preemptive_call.py: using MSISDN 7334 19:08:15.849376 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:16.502188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4575): Launched 19:08:16.880548 run osmo-msc_10.42.42.6(pid=4576): Launched 19:08:17.262459 run osmo-stp_10.42.42.5(pid=4573): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4573)] 19:08:17.547097 run osmo-stp_10.42.42.5(pid=4573): stdout: | (launched: 2022-12-09_19:08:15.271962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:17.704863 run osmo-stp_10.42.42.5(pid=4573): stderr: | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190815563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:17.858294 run osmo-stp_10.42.42.5(pid=4573): stdout: | (launched: 2022-12-09_19:08:15.271962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:18.006732 run osmo-stp_10.42.42.5(pid=4573): stderr: | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190815562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190815563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190815563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:18.182553 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4573): Process ended prematurely: osmo-stp_10.42.42.5(pid=4573) [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4573)] [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 19:08:18.191309 tst emergency_preemptive_call.py:32: Test FAILED (7.8 sec) 19:08:18.222196 run osmo-hlr_10.42.42.2(pid=4570): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4570)] 19:08:18.272872 run osmo-hlr_10.42.42.2(pid=4570): stdout: | (launched: 2022-12-09_19:08:14.005801) 19:08:18.324003 run osmo-hlr_10.42.42.2(pid=4570): stderr: | [0;m[1;31m20221209190814315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190814315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190814315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190814315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190814315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190814316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190814334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190814349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190814350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190814350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:18.394818 run osmo-msc_10.42.42.6(pid=4576): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4576)] 19:08:18.444097 run osmo-msc_10.42.42.6(pid=4576): stdout: | (launched: 2022-12-09_19:08:16.813289) 19:08:18.494925 run osmo-msc_10.42.42.6(pid=4576): stderr: | [0;m[38;5;43m20221209190817310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209190817310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93e2848c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209190817310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209190817310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209190817311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209190817311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209190817314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209190817314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209190817314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209190817314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:18.546418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4569): Terminating (SIGTERM) 19:08:18.588652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4572): Terminating (SIGTERM) 19:08:18.631875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4575): Terminating (SIGTERM) 19:08:18.675638 --- ParallelTerminationStrategy: PID 4569 died... 19:08:18.695372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4569): Terminated: ok {rc=0} 19:08:18.742760 --- ParallelTerminationStrategy: PID 4572 died... 19:08:18.762060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4572): Terminated: ok {rc=0} 19:08:18.807582 --- ParallelTerminationStrategy: PID 4575 died... 19:08:18.827256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4575): Terminated: ok {rc=0} 19:08:18.914469 bus /sierra_9: Setting Powered False 19:08:20.013509 bus /sierra_9: Setting Powered False 19:08:21.132713 bus /sierra_8: Setting Powered False 19:08:22.235835 bus /sierra_8: Setting Powered False 19:08:23.358432 bus /sierra_3: Setting Powered False 19:08:24.463852 bus /sierra_3: Setting Powered False 19:08:25.587702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 19:08:26.874982 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:08:26.879205 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:08:26.912204 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 19:08:26.949855 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:08:27.035946 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:08:27.069057 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 19:08:27.106571 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:08:27.702995 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 19:08:27.759174 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:27.770417 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:08:27.825263 tst cs_paging_gprs_active.py: using LAC 23102 19:08:27.953251 tst cs_paging_gprs_active.py: using RAC 152 19:08:28.080652 tst cs_paging_gprs_active.py: using CellId 23102 19:08:28.207490 tst cs_paging_gprs_active.py: using BVCI 23103 19:08:28.327119 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.338522 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.349796 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.361128 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.372359 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.383626 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.395123 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.406442 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:28.417919 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:28.536305 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:28.652398 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:08:28.861477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:29.171913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Launched 19:08:29.440602 run iperf3-srv_10.42.42.10(pid=4585): Launched 19:08:29.555888 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:08:29.762168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:30.071429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Launched 19:08:30.339336 run iperf3-srv_10.42.42.10(pid=4587): Launched 19:08:30.454214 tst cs_paging_gprs_active.py:38: start network... 19:08:30.660740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:31.163128 run create_hlr_db(pid=4588): Launched 19:08:31.326278 bus /sierra_2: Setting Powered False 19:08:32.391806 run create_hlr_db(pid=4588): Terminated: ok {rc=0} 19:08:32.853952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Launched 19:08:33.184362 run osmo-hlr_10.42.42.2(pid=4591): Launched 19:08:33.310549 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:33.880497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Launched 19:08:34.212114 run osmo-stp_10.42.42.5(pid=4594): Launched 19:08:34.339427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:08:34.909089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Launched 19:08:35.035200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:08:35.315231 run patchelf(pid=4597): Launched 19:08:35.497737 run osmo-stp_10.42.42.5(pid=4594): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] 19:08:35.637898 run osmo-stp_10.42.42.5(pid=4594): stdout: | (launched: 2022-12-09_19:08:34.151677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:35.778953 run osmo-stp_10.42.42.5(pid=4594): stderr: | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190834344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:35.920241 run osmo-stp_10.42.42.5(pid=4594): stdout: | (launched: 2022-12-09_19:08:34.151677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:36.055372 run osmo-stp_10.42.42.5(pid=4594): stderr: | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190834344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190834344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190834345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:36.215643 run patchelf(pid=4597): Terminating (SIGINT) 19:08:36.399960 run patchelf(pid=4597): Terminated: ok {rc=0} 19:08:36.533428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2363↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] [trial-2363↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 19:08:36.543743 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:08:36.572641 run osmo-hlr_10.42.42.2(pid=4591): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4591)] 19:08:36.622622 run osmo-hlr_10.42.42.2(pid=4591): stdout: | (launched: 2022-12-09_19:08:33.123878) 19:08:36.673970 run osmo-hlr_10.42.42.2(pid=4591): stderr: | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190833324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190833337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:36.725779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminating (SIGTERM) 19:08:36.767154 run iperf3-srv_10.42.42.10(pid=4585): Terminating (SIGTERM) 19:08:36.808666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminating (SIGTERM) 19:08:36.850235 run iperf3-srv_10.42.42.10(pid=4587): Terminating (SIGTERM) 19:08:36.891518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminating (SIGTERM) 19:08:36.932922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminating (SIGTERM) 19:08:36.974501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminating (SIGTERM) 19:08:37.016199 --- ParallelTerminationStrategy: PID 4584 died... 19:08:37.035574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminated: ok {rc=0} 19:08:37.081875 --- ParallelTerminationStrategy: PID 4585 died... 19:08:37.101186 run iperf3-srv_10.42.42.10(pid=4585): Terminated {rc=256} 19:08:37.147046 --- ParallelTerminationStrategy: PID 4586 died... 19:08:37.166357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminated: ok {rc=0} 19:08:37.212122 --- ParallelTerminationStrategy: PID 4587 died... 19:08:37.231294 run iperf3-srv_10.42.42.10(pid=4587): Terminated {rc=256} 19:08:37.277187 --- ParallelTerminationStrategy: PID 4590 died... 19:08:37.296385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminated: ok {rc=0} 19:08:37.342326 --- ParallelTerminationStrategy: PID 4593 died... 19:08:37.361550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminated: ok {rc=0} 19:08:37.407353 --- ParallelTerminationStrategy: PID 4596 died... 19:08:37.426680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminated: ok {rc=0} 19:08:37.513009 bus /gobi_0: Setting Powered False 19:08:38.611981 bus /gobi_0: Setting Powered False 19:08:39.727999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 19:08:40.873697 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:40.885236 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:08:40.937357 tst iperf3.py: using LAC 23103 19:08:41.058969 tst iperf3.py: using RAC 153 19:08:41.180530 tst iperf3.py: using CellId 23103 19:08:41.309059 tst iperf3.py: using BVCI 23104 19:08:41.428591 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.440082 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.451032 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.462426 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.473879 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.485257 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.496593 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.507660 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:41.518937 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:41.636493 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:08:41.845825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:42.159101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Launched 19:08:42.429169 run iperf3-srv_10.42.42.10(pid=4599): Launched 19:08:42.545496 tst iperf3.py:8: start network... 19:08:42.754189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:43.234909 run create_hlr_db(pid=4600): Launched 19:08:43.363734 bus /gobi_6: Setting Powered False 19:08:44.424926 run create_hlr_db(pid=4600): Terminated: ok {rc=0} 19:08:44.856716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Launched 19:08:45.165734 run osmo-hlr_10.42.42.2(pid=4603): Launched 19:08:45.282744 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:45.839515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Launched 19:08:46.205974 run osmo-stp_10.42.42.5(pid=4606): Launched 19:08:46.487267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:08:47.091709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Launched 19:08:47.231250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:08:47.511769 run patchelf(pid=4609): Launched 19:08:47.697206 run osmo-stp_10.42.42.5(pid=4606): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] 19:08:47.837276 run osmo-stp_10.42.42.5(pid=4606): stdout: | (launched: 2022-12-09_19:08:46.144904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:47.979226 run osmo-stp_10.42.42.5(pid=4606): stderr: | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190846358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:48.120755 run osmo-stp_10.42.42.5(pid=4606): stdout: | (launched: 2022-12-09_19:08:46.144904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:48.256521 run osmo-stp_10.42.42.5(pid=4606): stderr: | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190846358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190846358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190846359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:48.417039 run patchelf(pid=4609): Terminating (SIGINT) 19:08:48.602081 run patchelf(pid=4609): Terminated: ok {rc=0} 19:08:48.735322 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2363↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] [trial-2363↪gprs:trx-sysmocell5000↪iperf3.py:8] 19:08:48.745743 tst iperf3.py:8: Test FAILED (7.9 sec) 19:08:48.774508 run osmo-hlr_10.42.42.2(pid=4603): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4603)] 19:08:48.824925 run osmo-hlr_10.42.42.2(pid=4603): stdout: | (launched: 2022-12-09_19:08:45.108579) 19:08:48.877056 run osmo-hlr_10.42.42.2(pid=4603): stderr: | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190845286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190845298 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190845307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190845307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190845307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:48.929292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminating (SIGTERM) 19:08:48.971042 run iperf3-srv_10.42.42.10(pid=4599): Terminating (SIGTERM) 19:08:49.012880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminating (SIGTERM) 19:08:49.054620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminating (SIGTERM) 19:08:49.096523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminating (SIGTERM) 19:08:49.138627 --- ParallelTerminationStrategy: PID 4598 died... 19:08:49.158533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminated: ok {rc=0} 19:08:49.205441 --- ParallelTerminationStrategy: PID 4599 died... 19:08:49.225136 run iperf3-srv_10.42.42.10(pid=4599): Terminated {rc=256} 19:08:49.271901 --- ParallelTerminationStrategy: PID 4602 died... 19:08:49.291640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminated: ok {rc=0} 19:08:49.338530 --- ParallelTerminationStrategy: PID 4605 died... 19:08:49.358358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminated: ok {rc=0} 19:08:49.405203 --- ParallelTerminationStrategy: PID 4608 died... 19:08:49.424840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminated: ok {rc=0} 19:08:49.513497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 19:08:50.663084 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:50.674619 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:08:50.724703 tst iperf3m4.py: using LAC 23104 19:08:50.850368 tst iperf3m4.py: using RAC 154 19:08:50.970940 tst iperf3m4.py: using CellId 23104 19:08:51.090131 tst iperf3m4.py: using BVCI 23105 19:08:51.201898 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.212777 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.223498 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.234772 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.245927 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.256885 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.268409 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.279481 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:08:51.290848 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:51.407365 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:51.529512 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:51.646792 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:08:51.769558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:08:51.994177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:52.327337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Launched 19:08:52.616700 run iperf3-srv_10.42.42.10(pid=4611): Launched 19:08:52.740446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:08:52.964228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:53.296841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Launched 19:08:53.585394 run iperf3-srv_10.42.42.10(pid=4613): Launched 19:08:53.711073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:08:53.935158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:54.269270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Launched 19:08:54.556814 run iperf3-srv_10.42.42.10(pid=4615): Launched 19:08:54.680629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:08:54.903813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:08:55.236136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4616): Launched 19:08:55.524612 run iperf3-srv_10.42.42.10(pid=4617): Launched 19:08:55.649210 tst iperf3m4.py:8: start network... 19:08:55.864329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:56.342864 run create_hlr_db(pid=4618): Launched 19:08:56.469952 bus /gobi_6: Setting Powered False 19:08:57.534879 run create_hlr_db(pid=4618): Terminated: ok {rc=0} 19:08:57.994601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4620): Launched 19:08:58.327391 run osmo-hlr_10.42.42.2(pid=4621): Launched 19:08:58.454197 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:59.026590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4623): Launched 19:08:59.357056 run osmo-stp_10.42.42.5(pid=4624): Launched 19:08:59.481842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:09:00.050542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4626): Launched 19:09:00.177841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:09:00.457147 run patchelf(pid=4627): Launched 19:09:00.641456 run osmo-stp_10.42.42.5(pid=4624): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4624)] 19:09:00.780802 run osmo-stp_10.42.42.5(pid=4624): stdout: | (launched: 2022-12-09_19:08:59.296195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:00.928472 run osmo-stp_10.42.42.5(pid=4624): stderr: | [0;m[38;5;43m20221209190859486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190859487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190859487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190859487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:01.071816 run osmo-stp_10.42.42.5(pid=4624): stdout: | (launched: 2022-12-09_19:08:59.296195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:01.209304 run osmo-stp_10.42.42.5(pid=4624): stderr: | [0;m[38;5;43m20221209190859486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190859487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190859487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190859487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190859488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:01.371885 run patchelf(pid=4627): Terminating (SIGINT) 19:09:01.559592 run patchelf(pid=4627): Terminated: ok {rc=0} 19:09:01.695184 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4624): Process ended prematurely: osmo-stp_10.42.42.5(pid=4624) [trial-2363↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4624)] [trial-2363↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 19:09:01.706129 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:09:01.736279 run osmo-hlr_10.42.42.2(pid=4621): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4621)] 19:09:01.787648 run osmo-hlr_10.42.42.2(pid=4621): stdout: | (launched: 2022-12-09_19:08:58.266441) 19:09:01.840512 run osmo-hlr_10.42.42.2(pid=4621): stderr: | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190858462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190858474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190858485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190858485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190858485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:01.894525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminating (SIGTERM) 19:09:01.938314 run iperf3-srv_10.42.42.10(pid=4611): Terminating (SIGTERM) 19:09:01.984102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminating (SIGTERM) 19:09:02.027612 run iperf3-srv_10.42.42.10(pid=4613): Terminating (SIGTERM) 19:09:02.070477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Terminating (SIGTERM) 19:09:02.114192 run iperf3-srv_10.42.42.10(pid=4615): Terminating (SIGTERM) 19:09:02.158326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4616): Terminating (SIGTERM) 19:09:02.201341 run iperf3-srv_10.42.42.10(pid=4617): Terminating (SIGTERM) 19:09:02.244719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4620): Terminating (SIGTERM) 19:09:02.287087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4623): Terminating (SIGTERM) 19:09:02.329280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4626): Terminating (SIGTERM) 19:09:02.371528 --- ParallelTerminationStrategy: PID 4610 died... 19:09:02.391476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminated: ok {rc=0} 19:09:02.438199 --- ParallelTerminationStrategy: PID 4611 died... 19:09:02.457609 run iperf3-srv_10.42.42.10(pid=4611): Terminated {rc=256} 19:09:02.504013 --- ParallelTerminationStrategy: PID 4612 died... 19:09:02.523490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminated: ok {rc=0} 19:09:02.570124 --- ParallelTerminationStrategy: PID 4613 died... 19:09:02.589586 run iperf3-srv_10.42.42.10(pid=4613): Terminated {rc=256} 19:09:02.635454 --- ParallelTerminationStrategy: PID 4614 died... 19:09:02.654864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Terminated: ok {rc=0} 19:09:02.701272 --- ParallelTerminationStrategy: PID 4615 died... 19:09:02.720596 run iperf3-srv_10.42.42.10(pid=4615): Terminated {rc=256} 19:09:02.766523 --- ParallelTerminationStrategy: PID 4616 died... 19:09:02.785996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4616): Terminated: ok {rc=0} 19:09:02.831944 --- ParallelTerminationStrategy: PID 4617 died... 19:09:02.851318 run iperf3-srv_10.42.42.10(pid=4617): Terminated {rc=256} 19:09:02.897318 --- ParallelTerminationStrategy: PID 4620 died... 19:09:02.916711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4620): Terminated: ok {rc=0} 19:09:02.962780 --- ParallelTerminationStrategy: PID 4623 died... 19:09:02.982307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4623): Terminated: ok {rc=0} 19:09:03.028357 --- ParallelTerminationStrategy: PID 4626 died... 19:09:03.047735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4626): Terminated: ok {rc=0} 19:09:03.134861 bus /gobi_4: Setting Powered False 19:09:04.230528 bus /gobi_4: Setting Powered False 19:09:05.346280 bus /gobi_1: Setting Powered False 19:09:06.444533 bus /gobi_1: Setting Powered False 19:09:07.559227 bus /gobi_0: Setting Powered False 19:09:08.657322 bus /gobi_0: Setting Powered False 19:09:09.771257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 19:09:10.872366 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:10.884382 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:09:10.935704 tst ping.py: using LAC 23105 19:09:11.064833 tst ping.py: using RAC 155 19:09:11.190349 tst ping.py: using CellId 23105 19:09:11.314772 tst ping.py: using BVCI 23106 19:09:11.433237 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.444352 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.455477 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.466726 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.477914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.489043 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.500353 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:11.511604 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:11.633088 tst ping.py:19: start network... 19:09:11.851007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:12.351076 run create_hlr_db(pid=4628): Launched 19:09:12.474852 bus /gobi_6: Setting Powered False 19:09:13.538758 run create_hlr_db(pid=4628): Terminated: ok {rc=0} 19:09:13.971107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Launched 19:09:14.272764 run osmo-hlr_10.42.42.2(pid=4631): Launched 19:09:14.390247 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:14.929583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Launched 19:09:15.233132 run osmo-stp_10.42.42.5(pid=4634): Launched 19:09:15.348843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:09:15.881721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4636): Launched 19:09:16.031652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:09:16.341795 run patchelf(pid=4637): Launched 19:09:16.538333 run osmo-stp_10.42.42.5(pid=4634): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] 19:09:16.680523 run osmo-stp_10.42.42.5(pid=4634): stdout: | (launched: 2022-12-09_19:09:15.176628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:16.823823 run osmo-stp_10.42.42.5(pid=4634): stderr: | [0;m[38;5;43m20221209190915348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190915348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190915349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190915349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:16.968857 run osmo-stp_10.42.42.5(pid=4634): stdout: | (launched: 2022-12-09_19:09:15.176628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:17.105519 run osmo-stp_10.42.42.5(pid=4634): stderr: | [0;m[38;5;43m20221209190915348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190915348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190915349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190915349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190915350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:17.266117 run patchelf(pid=4637): Terminating (SIGINT) 19:09:17.447417 run patchelf(pid=4637): Terminated: ok {rc=0} 19:09:17.578588 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4634): Process ended prematurely: osmo-stp_10.42.42.5(pid=4634) [trial-2363↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] [trial-2363↪gprs:trx-sysmocell5000↪ping.py:22] 19:09:17.588429 tst ping.py:22: Test FAILED (6.7 sec) 19:09:17.617919 run osmo-hlr_10.42.42.2(pid=4631): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4631)] 19:09:17.668561 run osmo-hlr_10.42.42.2(pid=4631): stdout: | (launched: 2022-12-09_19:09:14.216798) 19:09:17.720523 run osmo-hlr_10.42.42.2(pid=4631): stderr: | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190914394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190914406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190914416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190914417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190914417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:17.773178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Terminating (SIGTERM) 19:09:17.815369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Terminating (SIGTERM) 19:09:17.857618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4636): Terminating (SIGTERM) 19:09:17.899938 --- ParallelTerminationStrategy: PID 4630 died... 19:09:17.920082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Terminated: ok {rc=0} 19:09:17.967438 --- ParallelTerminationStrategy: PID 4633 died... 19:09:17.987282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Terminated: ok {rc=0} 19:09:18.033787 --- ParallelTerminationStrategy: PID 4636 died... 19:09:18.053509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4636): Terminated: ok {rc=0} 19:09:18.142646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 19:09:19.229990 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.242015 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:09:19.294043 tst ping_idle_ping.py: using LAC 23106 19:09:19.422651 tst ping_idle_ping.py: using RAC 156 19:09:19.548460 tst ping_idle_ping.py: using CellId 23106 19:09:19.674583 tst ping_idle_ping.py: using BVCI 23107 19:09:19.793203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.804540 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.815758 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.827203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.838619 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.850045 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.861594 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:19.872935 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:19.990256 tst ping_idle_ping.py:24: start network... 19:09:20.191176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:20.659530 run create_hlr_db(pid=4638): Launched 19:09:20.785425 bus /gobi_6: Setting Powered False 19:09:21.849776 run create_hlr_db(pid=4638): Terminated: ok {rc=0} 19:09:22.296847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4640): Launched 19:09:22.618546 run osmo-hlr_10.42.42.2(pid=4641): Launched 19:09:22.741624 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:23.297141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4643): Launched 19:09:23.618551 run osmo-stp_10.42.42.5(pid=4644): Launched 19:09:23.740491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:09:24.293323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4646): Launched 19:09:24.415728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:09:24.688072 run patchelf(pid=4647): Launched 19:09:24.866524 run osmo-stp_10.42.42.5(pid=4644): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4644)] 19:09:25.002599 run osmo-stp_10.42.42.5(pid=4644): stdout: | (launched: 2022-12-09_19:09:23.559290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:25.139804 run osmo-stp_10.42.42.5(pid=4644): stderr: | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190923751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:25.277856 run osmo-stp_10.42.42.5(pid=4644): stdout: | (launched: 2022-12-09_19:09:23.559290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:25.409528 run osmo-stp_10.42.42.5(pid=4644): stderr: | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190923750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190923751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190923751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:25.566146 run patchelf(pid=4647): Terminating (SIGINT) 19:09:25.745854 run patchelf(pid=4647): Terminated: ok {rc=0} 19:09:25.875042 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4644): Process ended prematurely: osmo-stp_10.42.42.5(pid=4644) [trial-2363↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4644)] [trial-2363↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 19:09:25.884500 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:09:25.912818 run osmo-hlr_10.42.42.2(pid=4641): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4641)] 19:09:25.962961 run osmo-hlr_10.42.42.2(pid=4641): stdout: | (launched: 2022-12-09_19:09:22.559653) 19:09:26.014420 run osmo-hlr_10.42.42.2(pid=4641): stderr: | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190922756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190922768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190922777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190922777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190922777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:26.066301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4640): Terminating (SIGTERM) 19:09:26.107801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4643): Terminating (SIGTERM) 19:09:26.149484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4646): Terminating (SIGTERM) 19:09:26.191221 --- ParallelTerminationStrategy: PID 4640 died... 19:09:26.211123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4640): Terminated: ok {rc=0} 19:09:26.257620 --- ParallelTerminationStrategy: PID 4643 died... 19:09:26.276716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4643): Terminated: ok {rc=0} 19:09:26.323255 --- ParallelTerminationStrategy: PID 4646 died... 19:09:26.342623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4646): Terminated: ok {rc=0} 19:09:26.430489 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 19:09:27.743886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:09:27.750027 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:09:27.782934 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:09:27.820521 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:09:27.906607 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:09:27.939381 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:09:27.976766 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:09:28.571139 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:09:28.620062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:28.630832 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:09:28.681471 tst cs_paging_gprs_active.py: using LAC 23107 19:09:28.801888 tst cs_paging_gprs_active.py: using RAC 157 19:09:28.921797 tst cs_paging_gprs_active.py: using CellId 23107 19:09:29.041697 tst cs_paging_gprs_active.py: using BVCI 23108 19:09:29.152149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.163017 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.173650 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.184184 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.194711 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.205209 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.215838 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.226281 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:29.236927 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:29.355577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:29.473427 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:09:29.697273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:30.026810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4652): Launched 19:09:30.311547 run iperf3-srv_10.42.42.10(pid=4653): Launched 19:09:30.434234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:09:30.657385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:30.997721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4654): Launched 19:09:31.305098 run iperf3-srv_10.42.42.10(pid=4655): Launched 19:09:31.433488 tst cs_paging_gprs_active.py:38: start network... 19:09:31.646190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:32.147894 run create_hlr_db(pid=4656): Launched 19:09:32.301964 bus /gobi_6: Setting Powered False 19:09:33.364279 run create_hlr_db(pid=4656): Terminated: ok {rc=0} 19:09:33.811781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4658): Launched 19:09:34.138881 run osmo-hlr_10.42.42.2(pid=4659): Launched 19:09:34.263393 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:34.827406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4661): Launched 19:09:35.154856 run osmo-stp_10.42.42.5(pid=4662): Launched 19:09:35.279382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:09:35.843403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4664): Launched 19:09:35.968792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:09:36.245505 run patchelf(pid=4665): Launched 19:09:36.426821 run osmo-stp_10.42.42.5(pid=4662): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4662)] 19:09:36.565852 run osmo-stp_10.42.42.5(pid=4662): stdout: | (launched: 2022-12-09_19:09:35.095055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:36.705801 run osmo-stp_10.42.42.5(pid=4662): stderr: | [0;m[38;5;43m20221209190935282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190935283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190935283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190935283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:36.845810 run osmo-stp_10.42.42.5(pid=4662): stdout: | (launched: 2022-12-09_19:09:35.095055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:36.979812 run osmo-stp_10.42.42.5(pid=4662): stderr: | [0;m[38;5;43m20221209190935282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190935283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190935283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190935283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190935284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:37.138698 run patchelf(pid=4665): Terminating (SIGINT) 19:09:37.320552 run patchelf(pid=4665): Terminated: ok {rc=0} 19:09:37.452159 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4662): Process ended prematurely: osmo-stp_10.42.42.5(pid=4662) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4662)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:09:37.462273 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:09:37.490937 run osmo-hlr_10.42.42.2(pid=4659): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4659)] 19:09:37.540525 run osmo-hlr_10.42.42.2(pid=4659): stdout: | (launched: 2022-12-09_19:09:34.079130) 19:09:37.592341 run osmo-hlr_10.42.42.2(pid=4659): stderr: | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190934274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190934286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190934295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190934296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190934296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:37.644258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4652): Terminating (SIGTERM) 19:09:37.685785 run iperf3-srv_10.42.42.10(pid=4653): Terminating (SIGTERM) 19:09:37.727187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4654): Terminating (SIGTERM) 19:09:37.768706 run iperf3-srv_10.42.42.10(pid=4655): Terminating (SIGTERM) 19:09:37.810067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4658): Terminating (SIGTERM) 19:09:37.851444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4661): Terminating (SIGTERM) 19:09:37.892749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4664): Terminating (SIGTERM) 19:09:37.935000 --- ParallelTerminationStrategy: PID 4652 died... 19:09:37.954577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4652): Terminated: ok {rc=0} 19:09:38.000704 --- ParallelTerminationStrategy: PID 4653 died... 19:09:38.019883 run iperf3-srv_10.42.42.10(pid=4653): Terminated {rc=256} 19:09:38.065672 --- ParallelTerminationStrategy: PID 4654 died... 19:09:38.084723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4654): Terminated: ok {rc=0} 19:09:38.130612 --- ParallelTerminationStrategy: PID 4655 died... 19:09:38.149754 run iperf3-srv_10.42.42.10(pid=4655): Terminated {rc=256} 19:09:38.195489 --- ParallelTerminationStrategy: PID 4658 died... 19:09:38.214655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4658): Terminated: ok {rc=0} 19:09:38.260424 --- ParallelTerminationStrategy: PID 4661 died... 19:09:38.279703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4661): Terminated: ok {rc=0} 19:09:38.325485 --- ParallelTerminationStrategy: PID 4664 died... 19:09:38.344623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4664): Terminated: ok {rc=0} 19:09:38.430831 bus /gobi_0: Setting Powered False 19:09:39.529019 bus /gobi_0: Setting Powered False 19:09:40.644780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:09:41.792656 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:41.804873 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:09:41.859561 tst iperf3.py: using LAC 23108 19:09:41.988089 tst iperf3.py: using RAC 158 19:09:42.117242 tst iperf3.py: using CellId 23108 19:09:42.245355 tst iperf3.py: using BVCI 23109 19:09:42.356922 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.368048 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.378982 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.389879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.400463 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.411466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.422411 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.432808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:42.443528 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:42.558233 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:09:42.763515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:43.069730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4666): Launched 19:09:43.335226 run iperf3-srv_10.42.42.10(pid=4667): Launched 19:09:43.448882 tst iperf3.py:8: start network... 19:09:43.653825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:44.124766 run create_hlr_db(pid=4668): Launched 19:09:44.248109 bus /gobi_6: Setting Powered False 19:09:45.309021 run create_hlr_db(pid=4668): Terminated: ok {rc=0} 19:09:45.753997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4670): Launched 19:09:46.112715 run osmo-hlr_10.42.42.2(pid=4671): Launched 19:09:46.366428 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:47.053662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4673): Launched 19:09:47.374479 run osmo-stp_10.42.42.5(pid=4674): Launched 19:09:47.491672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:09:48.018667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4676): Launched 19:09:48.134648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:09:48.392245 run patchelf(pid=4677): Launched 19:09:48.561406 run osmo-stp_10.42.42.5(pid=4674): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4674)] 19:09:48.690488 run osmo-stp_10.42.42.5(pid=4674): stdout: | (launched: 2022-12-09_19:09:47.318260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:48.820805 run osmo-stp_10.42.42.5(pid=4674): stderr: | [0;m[38;5;43m20221209190947485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190947485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190947486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190947486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:48.951074 run osmo-stp_10.42.42.5(pid=4674): stdout: | (launched: 2022-12-09_19:09:47.318260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:49.075423 run osmo-stp_10.42.42.5(pid=4674): stderr: | [0;m[38;5;43m20221209190947485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190947485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190947486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190947486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190947487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:49.223276 run patchelf(pid=4677): Terminating (SIGINT) 19:09:49.402258 run patchelf(pid=4677): Terminated: ok {rc=0} 19:09:49.523406 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4674): Process ended prematurely: osmo-stp_10.42.42.5(pid=4674) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4674)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 19:09:49.532800 tst iperf3.py:8: Test FAILED (7.8 sec) 19:09:49.559762 run osmo-hlr_10.42.42.2(pid=4671): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4671)] 19:09:49.607551 run osmo-hlr_10.42.42.2(pid=4671): stdout: | (launched: 2022-12-09_19:09:46.046500) 19:09:49.656593 run osmo-hlr_10.42.42.2(pid=4671): stderr: | [0;m[1;31m20221209190946383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190946384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190946384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190946384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190946384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190946384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190946403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190946420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190946420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190946420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:49.705838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4666): Terminating (SIGTERM) 19:09:49.745513 run iperf3-srv_10.42.42.10(pid=4667): Terminating (SIGTERM) 19:09:49.785158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4670): Terminating (SIGTERM) 19:09:49.824816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4673): Terminating (SIGTERM) 19:09:49.864654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4676): Terminating (SIGTERM) 19:09:49.904554 --- ParallelTerminationStrategy: PID 4666 died... 19:09:49.923509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4666): Terminated: ok {rc=0} 19:09:49.967285 --- ParallelTerminationStrategy: PID 4667 died... 19:09:49.985545 run iperf3-srv_10.42.42.10(pid=4667): Terminated {rc=256} 19:09:50.028773 --- ParallelTerminationStrategy: PID 4670 died... 19:09:50.047294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4670): Terminated: ok {rc=0} 19:09:50.090736 --- ParallelTerminationStrategy: PID 4673 died... 19:09:50.109235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4673): Terminated: ok {rc=0} 19:09:50.152597 --- ParallelTerminationStrategy: PID 4676 died... 19:09:50.170970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4676): Terminated: ok {rc=0} 19:09:50.255966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:09:51.405134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.416824 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:09:51.466499 tst iperf3m4.py: using LAC 23109 19:09:51.587488 tst iperf3m4.py: using RAC 159 19:09:51.712494 tst iperf3m4.py: using CellId 23109 19:09:51.830624 tst iperf3m4.py: using BVCI 23110 19:09:51.941836 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.952870 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.963712 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.974750 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.985794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:51.996780 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:52.007881 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:52.018869 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:09:52.030269 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:52.149243 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:52.266584 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:52.386925 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:09:52.505803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:09:52.726797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:53.051053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4678): Launched 19:09:53.330930 run iperf3-srv_10.42.42.10(pid=4679): Launched 19:09:53.451884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:09:53.672009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:53.996529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4680): Launched 19:09:54.276232 run iperf3-srv_10.42.42.10(pid=4681): Launched 19:09:54.397282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:09:54.616507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:54.940398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4682): Launched 19:09:55.220082 run iperf3-srv_10.42.42.10(pid=4683): Launched 19:09:55.340775 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:09:55.559243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:55.883628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4684): Launched 19:09:56.162295 run iperf3-srv_10.42.42.10(pid=4685): Launched 19:09:56.283410 tst iperf3m4.py:8: start network... 19:09:56.503309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:57.006692 run create_hlr_db(pid=4686): Launched 19:09:57.129853 bus /gobi_6: Setting Powered False 19:09:58.194115 run create_hlr_db(pid=4686): Terminated: ok {rc=0} 19:09:58.625251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4688): Launched 19:09:58.928472 run osmo-hlr_10.42.42.2(pid=4689): Launched 19:09:59.043858 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:59.571848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4691): Launched 19:09:59.874700 run osmo-stp_10.42.42.5(pid=4692): Launched 19:09:59.989101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:00.512531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4694): Launched 19:10:00.629089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:00.897736 run patchelf(pid=4695): Launched 19:10:01.080558 run osmo-stp_10.42.42.5(pid=4692): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4692)] 19:10:01.212012 run osmo-stp_10.42.42.5(pid=4692): stdout: | (launched: 2022-12-09_19:09:59.819086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:01.345429 run osmo-stp_10.42.42.5(pid=4692): stderr: | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190959990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:01.490947 run osmo-stp_10.42.42.5(pid=4692): stdout: | (launched: 2022-12-09_19:09:59.819086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:01.618617 run osmo-stp_10.42.42.5(pid=4692): stderr: | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209190959990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209190959990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209190959991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:01.769447 run patchelf(pid=4695): Terminating (SIGINT) 19:10:01.943561 run patchelf(pid=4695): Terminated: ok {rc=0} 19:10:02.070190 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4692): Process ended prematurely: osmo-stp_10.42.42.5(pid=4692) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4692)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 19:10:02.080380 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:10:02.108720 run osmo-hlr_10.42.42.2(pid=4689): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4689)] 19:10:02.157192 run osmo-hlr_10.42.42.2(pid=4689): stdout: | (launched: 2022-12-09_19:09:58.872807) 19:10:02.206728 run osmo-hlr_10.42.42.2(pid=4689): stderr: | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209190959045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209190959058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209190959066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209190959066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209190959066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:02.257974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4678): Terminating (SIGTERM) 19:10:02.298857 run iperf3-srv_10.42.42.10(pid=4679): Terminating (SIGTERM) 19:10:02.351380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4680): Terminating (SIGTERM) 19:10:02.407151 run iperf3-srv_10.42.42.10(pid=4681): Terminating (SIGTERM) 19:10:02.469282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4682): Terminating (SIGTERM) 19:10:02.538161 run iperf3-srv_10.42.42.10(pid=4683): Terminating (SIGTERM) 19:10:02.601420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4684): Terminating (SIGTERM) 19:10:02.644641 run iperf3-srv_10.42.42.10(pid=4685): Terminating (SIGTERM) 19:10:02.687938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4688): Terminating (SIGTERM) 19:10:02.730536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4691): Terminating (SIGTERM) 19:10:02.772820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4694): Terminating (SIGTERM) 19:10:02.815871 --- ParallelTerminationStrategy: PID 4678 died... 19:10:02.835927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4678): Terminated: ok {rc=0} 19:10:02.884513 --- ParallelTerminationStrategy: PID 4679 died... 19:10:02.904269 run iperf3-srv_10.42.42.10(pid=4679): Terminated {rc=256} 19:10:02.952546 --- ParallelTerminationStrategy: PID 4680 died... 19:10:02.972209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4680): Terminated: ok {rc=0} 19:10:03.018954 --- ParallelTerminationStrategy: PID 4681 died... 19:10:03.038572 run iperf3-srv_10.42.42.10(pid=4681): Terminated {rc=256} 19:10:03.085232 --- ParallelTerminationStrategy: PID 4682 died... 19:10:03.104746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4682): Terminated: ok {rc=0} 19:10:03.151363 --- ParallelTerminationStrategy: PID 4683 died... 19:10:03.170856 run iperf3-srv_10.42.42.10(pid=4683): Terminated {rc=256} 19:10:03.217569 --- ParallelTerminationStrategy: PID 4684 died... 19:10:03.237309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4684): Terminated: ok {rc=0} 19:10:03.283887 --- ParallelTerminationStrategy: PID 4685 died... 19:10:03.303484 run iperf3-srv_10.42.42.10(pid=4685): Terminated {rc=256} 19:10:03.350702 --- ParallelTerminationStrategy: PID 4688 died... 19:10:03.370146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4688): Terminated: ok {rc=0} 19:10:03.416544 --- ParallelTerminationStrategy: PID 4691 died... 19:10:03.436180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4691): Terminated: ok {rc=0} 19:10:03.482694 --- ParallelTerminationStrategy: PID 4694 died... 19:10:03.502474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4694): Terminated: ok {rc=0} 19:10:03.589782 bus /gobi_4: Setting Powered False 19:10:04.688353 bus /gobi_4: Setting Powered False 19:10:05.803364 bus /gobi_1: Setting Powered False 19:10:06.901208 bus /gobi_1: Setting Powered False 19:10:08.019251 bus /gobi_0: Setting Powered False 19:10:09.117379 bus /gobi_0: Setting Powered False 19:10:10.233700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 19:10:11.335471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.347249 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:10:11.398359 tst ping.py: using LAC 23110 19:10:11.518307 tst ping.py: using RAC 160 19:10:11.638281 tst ping.py: using CellId 23110 19:10:11.758095 tst ping.py: using BVCI 23111 19:10:11.866585 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.877608 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.888221 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.898897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.909534 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.920217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.931068 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:11.941733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:10:12.055511 tst ping.py:19: start network... 19:10:12.256362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:12.725618 run create_hlr_db(pid=4708): Launched 19:10:12.891788 bus /gobi_6: Setting Powered False 19:10:13.954202 run create_hlr_db(pid=4708): Terminated: ok {rc=0} 19:10:14.417783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4979): Launched 19:10:14.737747 run osmo-hlr_10.42.42.2(pid=5047): Launched 19:10:14.895579 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:15.459815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5063): Launched 19:10:15.783790 run osmo-stp_10.42.42.5(pid=5064): Launched 19:10:16.048878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:16.662037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5066): Launched 19:10:16.794385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:17.060213 run patchelf(pid=5067): Launched 19:10:17.247986 run osmo-stp_10.42.42.5(pid=5064): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5064)] 19:10:17.380311 run osmo-stp_10.42.42.5(pid=5064): stdout: | (launched: 2022-12-09_19:10:15.724784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:17.510764 run osmo-stp_10.42.42.5(pid=5064): stderr: | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191015917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:17.640735 run osmo-stp_10.42.42.5(pid=5064): stdout: | (launched: 2022-12-09_19:10:15.724784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:17.764586 run osmo-stp_10.42.42.5(pid=5064): stderr: | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191015916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191015917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191015917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:17.911702 run patchelf(pid=5067): Terminating (SIGINT) 19:10:18.081380 run patchelf(pid=5067): Terminated: ok {rc=0} 19:10:18.203703 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5064): Process ended prematurely: osmo-stp_10.42.42.5(pid=5064) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5064)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 19:10:18.212723 tst ping.py:22: Test FAILED (6.9 sec) 19:10:18.240506 run osmo-hlr_10.42.42.2(pid=5047): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5047)] 19:10:18.288722 run osmo-hlr_10.42.42.2(pid=5047): stdout: | (launched: 2022-12-09_19:10:14.679159) 19:10:18.338326 run osmo-hlr_10.42.42.2(pid=5047): stderr: | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191014913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191014925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191014934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191014934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191014934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:18.388111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4979): Terminating (SIGTERM) 19:10:18.428168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5063): Terminating (SIGTERM) 19:10:18.468142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5066): Terminating (SIGTERM) 19:10:18.508583 --- ParallelTerminationStrategy: PID 4979 died... 19:10:18.527652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4979): Terminated: ok {rc=0} 19:10:18.572472 --- ParallelTerminationStrategy: PID 5063 died... 19:10:18.591101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5063): Terminated: ok {rc=0} 19:10:18.635921 --- ParallelTerminationStrategy: PID 5066 died... 19:10:18.654518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5066): Terminated: ok {rc=0} 19:10:18.741356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:10:19.829452 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:19.841515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:10:19.894421 tst ping_idle_ping.py: using LAC 23111 19:10:20.014924 tst ping_idle_ping.py: using RAC 161 19:10:20.135216 tst ping_idle_ping.py: using CellId 23111 19:10:20.255578 tst ping_idle_ping.py: using BVCI 23112 19:10:20.365452 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.376443 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.387474 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.398759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.410030 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.421281 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.432589 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:20.443980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:10:20.564590 tst ping_idle_ping.py:24: start network... 19:10:20.783786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:21.287610 run create_hlr_db(pid=5068): Launched 19:10:21.413287 bus /gobi_6: Setting Powered False 19:10:22.476552 run create_hlr_db(pid=5068): Terminated: ok {rc=0} 19:10:22.910035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Launched 19:10:23.252652 run osmo-hlr_10.42.42.2(pid=5081): Launched 19:10:23.442836 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:24.113766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Launched 19:10:24.432832 run osmo-stp_10.42.42.5(pid=5249): Launched 19:10:24.679372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:25.324049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5251): Launched 19:10:25.460154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:25.741026 run patchelf(pid=5252): Launched 19:10:25.938003 run osmo-stp_10.42.42.5(pid=5249): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5249)] 19:10:26.078222 run osmo-stp_10.42.42.5(pid=5249): stdout: | (launched: 2022-12-09_19:10:24.376765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:26.221241 run osmo-stp_10.42.42.5(pid=5249): stderr: | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191024664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:26.363877 run osmo-stp_10.42.42.5(pid=5249): stdout: | (launched: 2022-12-09_19:10:24.376765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:26.499950 run osmo-stp_10.42.42.5(pid=5249): stderr: | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191024663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191024664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191024664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:26.662190 run patchelf(pid=5252): Terminating (SIGINT) 19:10:26.848807 run patchelf(pid=5252): Terminated: ok {rc=0} 19:10:26.985628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5249): Process ended prematurely: osmo-stp_10.42.42.5(pid=5249) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5249)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 19:10:26.996359 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 19:10:27.027973 run osmo-hlr_10.42.42.2(pid=5081): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5081)] 19:10:27.080466 run osmo-hlr_10.42.42.2(pid=5081): stdout: | (launched: 2022-12-09_19:10:23.188464) 19:10:27.135449 run osmo-hlr_10.42.42.2(pid=5081): stderr: | [0;m[1;31m20221209191023515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191023515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191023516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191023516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191023516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191023516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191023532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191023544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191023545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191023545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:27.189847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminating (SIGTERM) 19:10:27.234870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminating (SIGTERM) 19:10:27.280717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5251): Terminating (SIGTERM) 19:10:27.327105 --- ParallelTerminationStrategy: PID 5070 died... 19:10:27.349228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminated: ok {rc=0} 19:10:27.400039 --- ParallelTerminationStrategy: PID 5244 died... 19:10:27.420594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminated: ok {rc=0} 19:10:27.470157 --- ParallelTerminationStrategy: PID 5251 died... 19:10:27.492160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5251): Terminated: ok {rc=0} 19:10:27.585656 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:10:28.910597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:10:28.922389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:10:28.977291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:10:29.019498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:10:29.108866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:10:29.147198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:10:29.186692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:10:29.780521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:10:29.834037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:29.845598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:10:29.917542 tst cs_paging_gprs_active.py: using LAC 23112 19:10:30.047872 tst cs_paging_gprs_active.py: using RAC 162 19:10:30.177616 tst cs_paging_gprs_active.py: using CellId 23112 19:10:30.300392 tst cs_paging_gprs_active.py: using BVCI 23113 19:10:30.412394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.423327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.434117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.444776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.455418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.466113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.476875 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.487553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:30.498388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:30.619457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:30.741468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:10:30.972670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:31.298213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5258): Launched 19:10:31.585847 run iperf3-srv_10.42.42.10(pid=5259): Launched 19:10:31.727819 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:10:31.941169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:32.256432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5260): Launched 19:10:32.553756 run iperf3-srv_10.42.42.10(pid=5261): Launched 19:10:32.668933 tst cs_paging_gprs_active.py:38: start network... 19:10:32.875401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:33.353560 run create_hlr_db(pid=5262): Launched 19:10:33.478774 bus /gobi_6: Setting Powered False 19:10:34.540913 run create_hlr_db(pid=5262): Terminated: ok {rc=0} 19:10:34.969094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5264): Launched 19:10:35.274824 run osmo-hlr_10.42.42.2(pid=5265): Launched 19:10:35.390922 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:35.931927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5267): Launched 19:10:36.237722 run osmo-stp_10.42.42.5(pid=5268): Launched 19:10:36.355658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:36.883404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5270): Launched 19:10:37.000937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:37.259926 run patchelf(pid=5271): Launched 19:10:37.429709 run osmo-stp_10.42.42.5(pid=5268): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5268)] 19:10:37.558865 run osmo-stp_10.42.42.5(pid=5268): stdout: | (launched: 2022-12-09_19:10:36.181389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:37.689508 run osmo-stp_10.42.42.5(pid=5268): stderr: | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191036355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:37.820614 run osmo-stp_10.42.42.5(pid=5268): stdout: | (launched: 2022-12-09_19:10:36.181389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:37.946013 run osmo-stp_10.42.42.5(pid=5268): stderr: | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191036354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191036355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:38.094419 run patchelf(pid=5271): Terminating (SIGINT) 19:10:38.265642 run patchelf(pid=5271): Terminated: ok {rc=0} 19:10:38.389601 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5268): Process ended prematurely: osmo-stp_10.42.42.5(pid=5268) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5268)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:10:38.399186 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:10:38.425889 run osmo-hlr_10.42.42.2(pid=5265): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5265)] 19:10:38.472531 run osmo-hlr_10.42.42.2(pid=5265): stdout: | (launched: 2022-12-09_19:10:35.218591) 19:10:38.521106 run osmo-hlr_10.42.42.2(pid=5265): stderr: | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191035396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191035409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191035418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191035418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191035418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:38.569764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5258): Terminating (SIGTERM) 19:10:38.608681 run iperf3-srv_10.42.42.10(pid=5259): Terminating (SIGTERM) 19:10:38.647454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5260): Terminating (SIGTERM) 19:10:38.686199 run iperf3-srv_10.42.42.10(pid=5261): Terminating (SIGTERM) 19:10:38.724882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5264): Terminating (SIGTERM) 19:10:38.763679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5267): Terminating (SIGTERM) 19:10:38.802329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5270): Terminating (SIGTERM) 19:10:38.841500 --- ParallelTerminationStrategy: PID 5258 died... 19:10:38.860169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5258): Terminated: ok {rc=0} 19:10:38.903198 --- ParallelTerminationStrategy: PID 5259 died... 19:10:38.921266 run iperf3-srv_10.42.42.10(pid=5259): Terminated {rc=256} 19:10:38.963984 --- ParallelTerminationStrategy: PID 5260 died... 19:10:38.982246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5260): Terminated: ok {rc=0} 19:10:39.025569 --- ParallelTerminationStrategy: PID 5261 died... 19:10:39.043651 run iperf3-srv_10.42.42.10(pid=5261): Terminated {rc=256} 19:10:39.086379 --- ParallelTerminationStrategy: PID 5264 died... 19:10:39.104451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5264): Terminated: ok {rc=0} 19:10:39.147404 --- ParallelTerminationStrategy: PID 5267 died... 19:10:39.165595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5267): Terminated: ok {rc=0} 19:10:39.208257 --- ParallelTerminationStrategy: PID 5270 died... 19:10:39.226454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5270): Terminated: ok {rc=0} 19:10:39.308045 bus /gobi_0: Setting Powered False 19:10:40.405162 bus /gobi_0: Setting Powered False 19:10:41.520723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:10:42.662712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:42.674687 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:10:42.750347 tst iperf3.py: using LAC 23113 19:10:42.873226 tst iperf3.py: using RAC 163 19:10:42.992251 tst iperf3.py: using CellId 23113 19:10:43.110575 tst iperf3.py: using BVCI 23114 19:10:43.221452 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.232276 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.243085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.253821 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.264384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.275056 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.285878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.296456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:43.307257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:43.427030 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:10:43.650460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:43.980565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5272): Launched 19:10:44.266387 run iperf3-srv_10.42.42.10(pid=5273): Launched 19:10:44.391044 tst iperf3.py:8: start network... 19:10:44.614066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:45.124196 run create_hlr_db(pid=5274): Launched 19:10:45.249552 bus /gobi_6: Setting Powered False 19:10:46.309855 run create_hlr_db(pid=5274): Terminated: ok {rc=0} 19:10:46.758002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5276): Launched 19:10:47.086947 run osmo-hlr_10.42.42.2(pid=5277): Launched 19:10:47.223401 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:47.768186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5279): Launched 19:10:48.073802 run osmo-stp_10.42.42.5(pid=5280): Launched 19:10:48.189967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:48.719103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5282): Launched 19:10:48.835675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:49.095317 run patchelf(pid=5283): Launched 19:10:49.266575 run osmo-stp_10.42.42.5(pid=5280): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5280)] 19:10:49.395718 run osmo-stp_10.42.42.5(pid=5280): stdout: | (launched: 2022-12-09_19:10:48.017728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:49.526703 run osmo-stp_10.42.42.5(pid=5280): stderr: | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191048191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:49.657607 run osmo-stp_10.42.42.5(pid=5280): stdout: | (launched: 2022-12-09_19:10:48.017728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:49.782484 run osmo-stp_10.42.42.5(pid=5280): stderr: | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191048191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191048191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191048192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:49.930455 run patchelf(pid=5283): Terminating (SIGINT) 19:10:50.101657 run patchelf(pid=5283): Terminated: ok {rc=0} 19:10:50.225799 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5280): Process ended prematurely: osmo-stp_10.42.42.5(pid=5280) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5280)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 19:10:50.235226 tst iperf3.py:8: Test FAILED (7.6 sec) 19:10:50.262166 run osmo-hlr_10.42.42.2(pid=5277): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5277)] 19:10:50.308943 run osmo-hlr_10.42.42.2(pid=5277): stdout: | (launched: 2022-12-09_19:10:47.028533) 19:10:50.357571 run osmo-hlr_10.42.42.2(pid=5277): stderr: | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191047228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191047240 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191047249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191047249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191047250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:50.406468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5272): Terminating (SIGTERM) 19:10:50.445427 run iperf3-srv_10.42.42.10(pid=5273): Terminating (SIGTERM) 19:10:50.484329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5276): Terminating (SIGTERM) 19:10:50.523356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5279): Terminating (SIGTERM) 19:10:50.562372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5282): Terminating (SIGTERM) 19:10:50.601696 --- ParallelTerminationStrategy: PID 5272 died... 19:10:50.620359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5272): Terminated: ok {rc=0} 19:10:50.663583 --- ParallelTerminationStrategy: PID 5273 died... 19:10:50.681809 run iperf3-srv_10.42.42.10(pid=5273): Terminated {rc=256} 19:10:50.725234 --- ParallelTerminationStrategy: PID 5276 died... 19:10:50.743524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5276): Terminated: ok {rc=0} 19:10:50.786781 --- ParallelTerminationStrategy: PID 5279 died... 19:10:50.805093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5279): Terminated: ok {rc=0} 19:10:50.848291 --- ParallelTerminationStrategy: PID 5282 died... 19:10:50.866598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5282): Terminated: ok {rc=0} 19:10:50.953152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:10:52.099942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.111618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:10:52.182000 tst iperf3m4.py: using LAC 23114 19:10:52.302710 tst iperf3m4.py: using RAC 164 19:10:52.423708 tst iperf3m4.py: using CellId 23114 19:10:52.548135 tst iperf3m4.py: using BVCI 23115 19:10:52.660592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.671535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.682257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.692840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.703515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.714235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.724923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.735497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:10:52.746399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:52.867657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:52.988063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:53.108024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:10:53.226493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:10:53.432724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:53.741433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5284): Launched 19:10:54.008550 run iperf3-srv_10.42.42.10(pid=5285): Launched 19:10:54.123270 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:10:54.328223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:54.636329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Launched 19:10:54.902860 run iperf3-srv_10.42.42.10(pid=5287): Launched 19:10:55.017538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:10:55.223112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:55.532408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5288): Launched 19:10:55.800253 run iperf3-srv_10.42.42.10(pid=5289): Launched 19:10:55.914913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:10:56.120238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:56.429130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5290): Launched 19:10:56.696363 run iperf3-srv_10.42.42.10(pid=5291): Launched 19:10:56.810904 tst iperf3m4.py:8: start network... 19:10:57.016263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:57.491543 run create_hlr_db(pid=5292): Launched 19:10:57.617695 bus /gobi_6: Setting Powered False 19:10:58.678287 run create_hlr_db(pid=5292): Terminated: ok {rc=0} 19:10:59.126392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Launched 19:10:59.456346 run osmo-hlr_10.42.42.2(pid=5295): Launched 19:10:59.582383 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:00.152566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Launched 19:11:00.485415 run osmo-stp_10.42.42.5(pid=5298): Launched 19:11:00.623885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:01.219446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5300): Launched 19:11:01.352829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:01.638241 run patchelf(pid=5301): Launched 19:11:01.835295 run osmo-stp_10.42.42.5(pid=5298): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] 19:11:01.978069 run osmo-stp_10.42.42.5(pid=5298): stdout: | (launched: 2022-12-09_19:11:00.423055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:02.121309 run osmo-stp_10.42.42.5(pid=5298): stderr: | [0;m[38;5;43m20221209191100625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191100626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191100626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191100626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:02.264397 run osmo-stp_10.42.42.5(pid=5298): stdout: | (launched: 2022-12-09_19:11:00.423055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:02.399678 run osmo-stp_10.42.42.5(pid=5298): stderr: | [0;m[38;5;43m20221209191100625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191100626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191100626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191100626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191100627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:02.560087 run patchelf(pid=5301): Terminating (SIGINT) 19:11:02.744939 run patchelf(pid=5301): Terminated: ok {rc=0} 19:11:02.878180 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5298): Process ended prematurely: osmo-stp_10.42.42.5(pid=5298) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:11:02.888777 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:11:02.919631 run osmo-hlr_10.42.42.2(pid=5295): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5295)] 19:11:02.970374 run osmo-hlr_10.42.42.2(pid=5295): stdout: | (launched: 2022-12-09_19:10:59.396592) 19:11:03.022706 run osmo-hlr_10.42.42.2(pid=5295): stderr: | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191059597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191059609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191059617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191059618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191059618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:03.075296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5284): Terminating (SIGTERM) 19:11:03.117804 run iperf3-srv_10.42.42.10(pid=5285): Terminating (SIGTERM) 19:11:03.160027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Terminating (SIGTERM) 19:11:03.202632 run iperf3-srv_10.42.42.10(pid=5287): Terminating (SIGTERM) 19:11:03.245066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5288): Terminating (SIGTERM) 19:11:03.287554 run iperf3-srv_10.42.42.10(pid=5289): Terminating (SIGTERM) 19:11:03.330007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5290): Terminating (SIGTERM) 19:11:03.372253 run iperf3-srv_10.42.42.10(pid=5291): Terminating (SIGTERM) 19:11:03.414610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Terminating (SIGTERM) 19:11:03.457016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Terminating (SIGTERM) 19:11:03.499327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5300): Terminating (SIGTERM) 19:11:03.542003 --- ParallelTerminationStrategy: PID 5284 died... 19:11:03.561778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5284): Terminated: ok {rc=0} 19:11:03.609702 --- ParallelTerminationStrategy: PID 5285 died... 19:11:03.629119 run iperf3-srv_10.42.42.10(pid=5285): Terminated {rc=256} 19:11:03.676775 --- ParallelTerminationStrategy: PID 5286 died... 19:11:03.696169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Terminated: ok {rc=0} 19:11:03.743650 --- ParallelTerminationStrategy: PID 5287 died... 19:11:03.763107 run iperf3-srv_10.42.42.10(pid=5287): Terminated {rc=256} 19:11:03.810289 --- ParallelTerminationStrategy: PID 5288 died... 19:11:03.829803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5288): Terminated: ok {rc=0} 19:11:03.877061 --- ParallelTerminationStrategy: PID 5289 died... 19:11:03.896429 run iperf3-srv_10.42.42.10(pid=5289): Terminated {rc=256} 19:11:03.943548 --- ParallelTerminationStrategy: PID 5290 died... 19:11:03.963204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5290): Terminated: ok {rc=0} 19:11:04.011066 --- ParallelTerminationStrategy: PID 5291 died... 19:11:04.030618 run iperf3-srv_10.42.42.10(pid=5291): Terminated {rc=256} 19:11:04.077976 --- ParallelTerminationStrategy: PID 5294 died... 19:11:04.097725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5294): Terminated: ok {rc=0} 19:11:04.145346 --- ParallelTerminationStrategy: PID 5297 died... 19:11:04.164910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5297): Terminated: ok {rc=0} 19:11:04.212261 --- ParallelTerminationStrategy: PID 5300 died... 19:11:04.231984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5300): Terminated: ok {rc=0} 19:11:04.321231 bus /gobi_4: Setting Powered False 19:11:05.418550 bus /gobi_4: Setting Powered False 19:11:06.534382 bus /gobi_1: Setting Powered False 19:11:07.629030 bus /gobi_1: Setting Powered False 19:11:08.742494 bus /gobi_0: Setting Powered False 19:11:09.838704 bus /gobi_0: Setting Powered False 19:11:10.956159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:11:12.059032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.070771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:11:12.141327 tst ping.py: using LAC 23115 19:11:12.258800 tst ping.py: using RAC 165 19:11:12.378127 tst ping.py: using CellId 23115 19:11:12.495403 tst ping.py: using BVCI 23116 19:11:12.604382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.615514 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.626496 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.637253 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.647924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.658783 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.669765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:12.680457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:11:12.796655 tst ping.py:19: start network... 19:11:12.998121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:13.464688 run create_hlr_db(pid=5302): Launched 19:11:13.587953 bus /gobi_6: Setting Powered False 19:11:14.648730 run create_hlr_db(pid=5302): Terminated: ok {rc=0} 19:11:15.090158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5304): Launched 19:11:15.415246 run osmo-hlr_10.42.42.2(pid=5305): Launched 19:11:15.539399 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:16.115007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5307): Launched 19:11:16.444007 run osmo-stp_10.42.42.5(pid=5308): Launched 19:11:16.632663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:17.350545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5310): Launched 19:11:17.465372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:17.720176 run patchelf(pid=5311): Launched 19:11:17.887187 run osmo-stp_10.42.42.5(pid=5308): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5308)] 19:11:18.014500 run osmo-stp_10.42.42.5(pid=5308): stdout: | (launched: 2022-12-09_19:11:16.387468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:18.143866 run osmo-stp_10.42.42.5(pid=5308): stderr: | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191116740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:18.272467 run osmo-stp_10.42.42.5(pid=5308): stdout: | (launched: 2022-12-09_19:11:16.387468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:18.396325 run osmo-stp_10.42.42.5(pid=5308): stderr: | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191116739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191116740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191116740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:18.542489 run patchelf(pid=5311): Terminating (SIGINT) 19:11:18.711267 run patchelf(pid=5311): Terminated: ok {rc=0} 19:11:18.832434 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5308): Process ended prematurely: osmo-stp_10.42.42.5(pid=5308) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5308)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 19:11:18.841454 tst ping.py:22: Test FAILED (6.8 sec) 19:11:18.868288 run osmo-hlr_10.42.42.2(pid=5305): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5305)] 19:11:18.915630 run osmo-hlr_10.42.42.2(pid=5305): stdout: | (launched: 2022-12-09_19:11:15.356265) 19:11:18.964401 run osmo-hlr_10.42.42.2(pid=5305): stderr: | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191115554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191115567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191115577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191115578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191115578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:19.013333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5304): Terminating (SIGTERM) 19:11:19.052349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5307): Terminating (SIGTERM) 19:11:19.091230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5310): Terminating (SIGTERM) 19:11:19.130932 --- ParallelTerminationStrategy: PID 5304 died... 19:11:19.149741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5304): Terminated: ok {rc=0} 19:11:19.193843 --- ParallelTerminationStrategy: PID 5307 died... 19:11:19.212183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5307): Terminated: ok {rc=0} 19:11:19.255812 --- ParallelTerminationStrategy: PID 5310 died... 19:11:19.274303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5310): Terminated: ok {rc=0} 19:11:19.359519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:11:20.447138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:20.458852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:11:20.529406 tst ping_idle_ping.py: using LAC 23116 19:11:20.649067 tst ping_idle_ping.py: using RAC 166 19:11:20.766620 tst ping_idle_ping.py: using CellId 23116 19:11:20.886297 tst ping_idle_ping.py: using BVCI 23117 19:11:20.995299 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.006380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.017252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.028015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.038860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.049636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.060505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:21.071321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:11:21.189452 tst ping_idle_ping.py:24: start network... 19:11:21.410048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:21.921330 run create_hlr_db(pid=5313): Launched 19:11:22.048245 bus /gobi_6: Setting Powered False 19:11:23.112805 run create_hlr_db(pid=5313): Terminated: ok {rc=0} 19:11:23.547144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5315): Launched 19:11:23.851006 run osmo-hlr_10.42.42.2(pid=5316): Launched 19:11:23.966346 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:24.485145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5318): Launched 19:11:24.786657 run osmo-stp_10.42.42.5(pid=5319): Launched 19:11:24.901197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:25.420799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5321): Launched 19:11:25.535399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:25.789212 run patchelf(pid=5322): Launched 19:11:25.955794 run osmo-stp_10.42.42.5(pid=5319): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5319)] 19:11:26.082759 run osmo-stp_10.42.42.5(pid=5319): stdout: | (launched: 2022-12-09_19:11:24.730558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:26.211324 run osmo-stp_10.42.42.5(pid=5319): stderr: | [0;m[38;5;43m20221209191124901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191124901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191124902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191124902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:26.340264 run osmo-stp_10.42.42.5(pid=5319): stdout: | (launched: 2022-12-09_19:11:24.730558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:26.462975 run osmo-stp_10.42.42.5(pid=5319): stderr: | [0;m[38;5;43m20221209191124901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191124901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191124902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191124902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191124903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:26.608527 run patchelf(pid=5322): Terminating (SIGINT) 19:11:26.776330 run patchelf(pid=5322): Terminated: ok {rc=0} 19:11:26.897223 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5319): Process ended prematurely: osmo-stp_10.42.42.5(pid=5319) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5319)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:11:26.906207 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:11:26.932342 run osmo-hlr_10.42.42.2(pid=5316): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5316)] 19:11:26.979159 run osmo-hlr_10.42.42.2(pid=5316): stdout: | (launched: 2022-12-09_19:11:23.795349) 19:11:27.027697 run osmo-hlr_10.42.42.2(pid=5316): stderr: | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191123976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191123988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191123997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191123997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191123997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:27.076822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5315): Terminating (SIGTERM) 19:11:27.116087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5318): Terminating (SIGTERM) 19:11:27.155204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5321): Terminating (SIGTERM) 19:11:27.194368 --- ParallelTerminationStrategy: PID 5315 died... 19:11:27.213021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5315): Terminated: ok {rc=0} 19:11:27.256096 --- ParallelTerminationStrategy: PID 5318 died... 19:11:27.274359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5318): Terminated: ok {rc=0} 19:11:27.317357 --- ParallelTerminationStrategy: PID 5321 died... 19:11:27.335585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5321): Terminated: ok {rc=0} 19:11:27.420161 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:11:28.728196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:28.734814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:11:28.768350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:11:28.805957 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:11:28.890612 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:11:28.923693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:11:28.961761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:11:29.558108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:11:29.607367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:29.618383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:11:29.686557 tst cs_paging_gprs_active.py: using LAC 23117 19:11:29.805132 tst cs_paging_gprs_active.py: using RAC 167 19:11:29.923883 tst cs_paging_gprs_active.py: using CellId 23117 19:11:30.045149 tst cs_paging_gprs_active.py: using BVCI 23118 19:11:30.156115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.167077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.177851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.188482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.199173 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.209882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.220548 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.231184 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:30.242052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:30.362500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:30.481086 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:11:30.688282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:31.002430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5326): Launched 19:11:31.284064 run iperf3-srv_10.42.42.10(pid=5327): Launched 19:11:31.417251 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:11:31.626268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:31.941148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5328): Launched 19:11:32.296659 run iperf3-srv_10.42.42.10(pid=5329): Launched 19:11:32.426444 tst cs_paging_gprs_active.py:38: start network... 19:11:32.632719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:33.107953 run create_hlr_db(pid=5330): Launched 19:11:33.233145 bus /gobi_6: Setting Powered False 19:11:34.294204 run create_hlr_db(pid=5330): Terminated: ok {rc=0} 19:11:34.742373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5332): Launched 19:11:35.072097 run osmo-hlr_10.42.42.2(pid=5333): Launched 19:11:35.198846 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:35.766052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5335): Launched 19:11:36.097089 run osmo-stp_10.42.42.5(pid=5336): Launched 19:11:36.222119 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:36.790705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5338): Launched 19:11:36.917595 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:37.195833 run patchelf(pid=5339): Launched 19:11:37.378349 run osmo-stp_10.42.42.5(pid=5336): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5336)] 19:11:37.518115 run osmo-stp_10.42.42.5(pid=5336): stdout: | (launched: 2022-12-09_19:11:36.036877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:37.659448 run osmo-stp_10.42.42.5(pid=5336): stderr: | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191136234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:37.800363 run osmo-stp_10.42.42.5(pid=5336): stdout: | (launched: 2022-12-09_19:11:36.036877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:37.935266 run osmo-stp_10.42.42.5(pid=5336): stderr: | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191136233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191136234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191136234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:38.095345 run patchelf(pid=5339): Terminating (SIGINT) 19:11:38.278728 run patchelf(pid=5339): Terminated: ok {rc=0} 19:11:38.411266 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5336): Process ended prematurely: osmo-stp_10.42.42.5(pid=5336) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5336)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:11:38.421671 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:11:38.450705 run osmo-hlr_10.42.42.2(pid=5333): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5333)] 19:11:38.500658 run osmo-hlr_10.42.42.2(pid=5333): stdout: | (launched: 2022-12-09_19:11:35.012204) 19:11:38.552320 run osmo-hlr_10.42.42.2(pid=5333): stderr: | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191135211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191135226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191135234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191135234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191135234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:38.604575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5326): Terminating (SIGTERM) 19:11:38.646564 run iperf3-srv_10.42.42.10(pid=5327): Terminating (SIGTERM) 19:11:38.688160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5328): Terminating (SIGTERM) 19:11:38.729920 run iperf3-srv_10.42.42.10(pid=5329): Terminating (SIGTERM) 19:11:38.771475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5332): Terminating (SIGTERM) 19:11:38.813153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5335): Terminating (SIGTERM) 19:11:38.854803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5338): Terminating (SIGTERM) 19:11:38.896585 --- ParallelTerminationStrategy: PID 5326 died... 19:11:38.916512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5326): Terminated: ok {rc=0} 19:11:38.962838 --- ParallelTerminationStrategy: PID 5327 died... 19:11:38.982110 run iperf3-srv_10.42.42.10(pid=5327): Terminated {rc=256} 19:11:39.028295 --- ParallelTerminationStrategy: PID 5328 died... 19:11:39.047688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5328): Terminated: ok {rc=0} 19:11:39.093765 --- ParallelTerminationStrategy: PID 5329 died... 19:11:39.113146 run iperf3-srv_10.42.42.10(pid=5329): Terminated {rc=256} 19:11:39.158972 --- ParallelTerminationStrategy: PID 5332 died... 19:11:39.178251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5332): Terminated: ok {rc=0} 19:11:39.224137 --- ParallelTerminationStrategy: PID 5335 died... 19:11:39.243396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5335): Terminated: ok {rc=0} 19:11:39.289403 --- ParallelTerminationStrategy: PID 5338 died... 19:11:39.308539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5338): Terminated: ok {rc=0} 19:11:39.395822 bus /gobi_0: Setting Powered False 19:11:40.494089 bus /gobi_0: Setting Powered False 19:11:41.608728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:11:42.753158 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:42.764618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:11:42.837537 tst iperf3.py: using LAC 23118 19:11:42.968390 tst iperf3.py: using RAC 168 19:11:43.099717 tst iperf3.py: using CellId 23118 19:11:43.227862 tst iperf3.py: using BVCI 23119 19:11:43.347217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.358910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.370422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.382015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.393563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.405037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.416653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.428284 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:43.439981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:43.557847 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:11:43.782067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:44.114058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Launched 19:11:44.401689 run iperf3-srv_10.42.42.10(pid=5341): Launched 19:11:44.525456 tst iperf3.py:8: start network... 19:11:44.749663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:45.261208 run create_hlr_db(pid=5342): Launched 19:11:45.385695 bus /gobi_6: Setting Powered False 19:11:46.448801 run create_hlr_db(pid=5342): Terminated: ok {rc=0} 19:11:46.917278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Launched 19:11:47.263105 run osmo-hlr_10.42.42.2(pid=5345): Launched 19:11:47.390425 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:47.958909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Launched 19:11:48.289877 run osmo-stp_10.42.42.5(pid=5348): Launched 19:11:48.416547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:48.985669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Launched 19:11:49.111220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:49.389729 run patchelf(pid=5351): Launched 19:11:49.573039 run osmo-stp_10.42.42.5(pid=5348): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] 19:11:49.713427 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-09_19:11:48.229998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:49.854803 run osmo-stp_10.42.42.5(pid=5348): stderr: | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191148423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:49.996188 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-09_19:11:48.229998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:50.131918 run osmo-stp_10.42.42.5(pid=5348): stderr: | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191148423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191148423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191148426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:50.292438 run patchelf(pid=5351): Terminating (SIGINT) 19:11:50.476699 run patchelf(pid=5351): Terminated: ok {rc=0} 19:11:50.609913 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 19:11:50.620324 tst iperf3.py:8: Test FAILED (7.9 sec) 19:11:50.649673 run osmo-hlr_10.42.42.2(pid=5345): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5345)] 19:11:50.699422 run osmo-hlr_10.42.42.2(pid=5345): stdout: | (launched: 2022-12-09_19:11:47.202788) 19:11:50.750779 run osmo-hlr_10.42.42.2(pid=5345): stderr: | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191147400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191147413 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191147421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191147421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191147421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:50.802582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminating (SIGTERM) 19:11:50.844269 run iperf3-srv_10.42.42.10(pid=5341): Terminating (SIGTERM) 19:11:50.885854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminating (SIGTERM) 19:11:50.927587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminating (SIGTERM) 19:11:50.969139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Terminating (SIGTERM) 19:11:51.010993 --- ParallelTerminationStrategy: PID 5340 died... 19:11:51.030810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminated: ok {rc=0} 19:11:51.077290 --- ParallelTerminationStrategy: PID 5341 died... 19:11:51.096525 run iperf3-srv_10.42.42.10(pid=5341): Terminated {rc=256} 19:11:51.142769 --- ParallelTerminationStrategy: PID 5344 died... 19:11:51.162222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminated: ok {rc=0} 19:11:51.208510 --- ParallelTerminationStrategy: PID 5347 died... 19:11:51.228015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminated: ok {rc=0} 19:11:51.274177 --- ParallelTerminationStrategy: PID 5350 died... 19:11:51.293564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Terminated: ok {rc=0} 19:11:51.380630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:11:52.528648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:52.540637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:11:52.612064 tst iperf3m4.py: using LAC 23119 19:11:52.734347 tst iperf3m4.py: using RAC 169 19:11:52.864141 tst iperf3m4.py: using CellId 23119 19:11:52.992436 tst iperf3m4.py: using BVCI 23120 19:11:53.111630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.123177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.134630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.146220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.157990 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.169559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.181323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.192690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:11:53.204385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:53.323948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:53.446136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:53.567640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:11:53.686074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:11:53.893647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:54.202406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5352): Launched 19:11:54.471193 run iperf3-srv_10.42.42.10(pid=5353): Launched 19:11:54.587309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:11:54.792942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:55.100602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Launched 19:11:55.366797 run iperf3-srv_10.42.42.10(pid=5355): Launched 19:11:55.481269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:11:55.687993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:55.996452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5356): Launched 19:11:56.263491 run iperf3-srv_10.42.42.10(pid=5357): Launched 19:11:56.378069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:11:56.583751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:56.892523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5358): Launched 19:11:57.160072 run iperf3-srv_10.42.42.10(pid=5359): Launched 19:11:57.274487 tst iperf3m4.py:8: start network... 19:11:57.479832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:57.954752 run create_hlr_db(pid=5360): Launched 19:11:58.078247 bus /gobi_6: Setting Powered False 19:11:59.138651 run create_hlr_db(pid=5360): Terminated: ok {rc=0} 19:11:59.586249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Launched 19:11:59.918108 run osmo-hlr_10.42.42.2(pid=5363): Launched 19:12:00.045026 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:00.617476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Launched 19:12:00.985688 run osmo-stp_10.42.42.5(pid=5366): Launched 19:12:01.259027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:02.143925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5368): Launched 19:12:02.282897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:02.561982 run patchelf(pid=5369): Launched 19:12:02.744147 run osmo-stp_10.42.42.5(pid=5366): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] 19:12:02.883152 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_19:12:00.910984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:03.023803 run osmo-stp_10.42.42.5(pid=5366): stderr: | [0;m[38;5;43m20221209191201393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191201393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191201394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191201394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:03.164234 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_19:12:00.910984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:03.298486 run osmo-stp_10.42.42.5(pid=5366): stderr: | [0;m[38;5;43m20221209191201393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191201393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191201394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191201394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191201395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:03.458047 run patchelf(pid=5369): Terminating (SIGINT) 19:12:03.642020 run patchelf(pid=5369): Terminated: ok {rc=0} 19:12:03.774870 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:12:03.785311 tst iperf3m4.py:8: Test FAILED (11.3 sec) 19:12:03.814899 run osmo-hlr_10.42.42.2(pid=5363): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5363)] 19:12:03.865331 run osmo-hlr_10.42.42.2(pid=5363): stdout: | (launched: 2022-12-09_19:11:59.857721) 19:12:03.917362 run osmo-hlr_10.42.42.2(pid=5363): stderr: | [0;m[1;31m20221209191200058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191200058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191200059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191200059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191200059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191200059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191200072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191200082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191200082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191200082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:03.969854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5352): Terminating (SIGTERM) 19:12:04.011976 run iperf3-srv_10.42.42.10(pid=5353): Terminating (SIGTERM) 19:12:04.054001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Terminating (SIGTERM) 19:12:04.096370 run iperf3-srv_10.42.42.10(pid=5355): Terminating (SIGTERM) 19:12:04.138344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5356): Terminating (SIGTERM) 19:12:04.180399 run iperf3-srv_10.42.42.10(pid=5357): Terminating (SIGTERM) 19:12:04.222308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5358): Terminating (SIGTERM) 19:12:04.264463 run iperf3-srv_10.42.42.10(pid=5359): Terminating (SIGTERM) 19:12:04.306586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminating (SIGTERM) 19:12:04.348989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminating (SIGTERM) 19:12:04.391129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5368): Terminating (SIGTERM) 19:12:04.433578 --- ParallelTerminationStrategy: PID 5352 died... 19:12:04.453572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5352): Terminated: ok {rc=0} 19:12:04.500510 --- ParallelTerminationStrategy: PID 5353 died... 19:12:04.520102 run iperf3-srv_10.42.42.10(pid=5353): Terminated {rc=256} 19:12:04.566626 --- ParallelTerminationStrategy: PID 5354 died... 19:12:04.586341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Terminated: ok {rc=0} 19:12:04.633421 --- ParallelTerminationStrategy: PID 5355 died... 19:12:04.652741 run iperf3-srv_10.42.42.10(pid=5355): Terminated {rc=256} 19:12:04.699592 --- ParallelTerminationStrategy: PID 5356 died... 19:12:04.719247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5356): Terminated: ok {rc=0} 19:12:04.766016 --- ParallelTerminationStrategy: PID 5357 died... 19:12:04.785678 run iperf3-srv_10.42.42.10(pid=5357): Terminated {rc=256} 19:12:04.832208 --- ParallelTerminationStrategy: PID 5358 died... 19:12:04.851947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5358): Terminated: ok {rc=0} 19:12:04.898568 --- ParallelTerminationStrategy: PID 5359 died... 19:12:04.918033 run iperf3-srv_10.42.42.10(pid=5359): Terminated {rc=256} 19:12:04.964473 --- ParallelTerminationStrategy: PID 5362 died... 19:12:04.984053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminated: ok {rc=0} 19:12:05.030701 --- ParallelTerminationStrategy: PID 5365 died... 19:12:05.050211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminated: ok {rc=0} 19:12:05.097115 --- ParallelTerminationStrategy: PID 5368 died... 19:12:05.116857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5368): Terminated: ok {rc=0} 19:12:05.205943 bus /gobi_4: Setting Powered False 19:12:06.305681 bus /gobi_4: Setting Powered False 19:12:07.421910 bus /gobi_1: Setting Powered False 19:12:08.519193 bus /gobi_1: Setting Powered False 19:12:09.634753 bus /gobi_0: Setting Powered False 19:12:10.734286 bus /gobi_0: Setting Powered False 19:12:11.848449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:12:12.948330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:12.959868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:12:13.031026 tst ping.py: using LAC 23120 19:12:13.149434 tst ping.py: using RAC 170 19:12:13.276252 tst ping.py: using CellId 23120 19:12:13.401376 tst ping.py: using BVCI 23121 19:12:13.518139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.529881 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.541360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.553351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.565094 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.576525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.588365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:13.599742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:12:13.715140 tst ping.py:19: start network... 19:12:13.917591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:14.382417 run create_hlr_db(pid=5370): Launched 19:12:14.507839 bus /gobi_6: Setting Powered False 19:12:15.568351 run create_hlr_db(pid=5370): Terminated: ok {rc=0} 19:12:16.022872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5372): Launched 19:12:16.351235 run osmo-hlr_10.42.42.2(pid=5373): Launched 19:12:16.647899 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:17.394417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5375): Launched 19:12:17.707354 run osmo-stp_10.42.42.5(pid=5376): Launched 19:12:17.821749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:18.356311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5378): Launched 19:12:18.471834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:18.725303 run patchelf(pid=5379): Launched 19:12:18.891824 run osmo-stp_10.42.42.5(pid=5376): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5376)] 19:12:19.018732 run osmo-stp_10.42.42.5(pid=5376): stdout: | (launched: 2022-12-09_19:12:17.651997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:19.147109 run osmo-stp_10.42.42.5(pid=5376): stderr: | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191217823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:19.274947 run osmo-stp_10.42.42.5(pid=5376): stdout: | (launched: 2022-12-09_19:12:17.651997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:19.397543 run osmo-stp_10.42.42.5(pid=5376): stderr: | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191217822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191217823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191217823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:19.542914 run patchelf(pid=5379): Terminating (SIGINT) 19:12:19.711211 run patchelf(pid=5379): Terminated: ok {rc=0} 19:12:19.832917 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5376): Process ended prematurely: osmo-stp_10.42.42.5(pid=5376) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5376)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 19:12:19.842052 tst ping.py:22: Test FAILED (6.9 sec) 19:12:19.868276 run osmo-hlr_10.42.42.2(pid=5373): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5373)] 19:12:19.915352 run osmo-hlr_10.42.42.2(pid=5373): stdout: | (launched: 2022-12-09_19:12:16.289144) 19:12:19.963695 run osmo-hlr_10.42.42.2(pid=5373): stderr: | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191216576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191216597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191216614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191216614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191216614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:20.012441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5372): Terminating (SIGTERM) 19:12:20.051332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5375): Terminating (SIGTERM) 19:12:20.090288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5378): Terminating (SIGTERM) 19:12:20.130024 --- ParallelTerminationStrategy: PID 5372 died... 19:12:20.148740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5372): Terminated: ok {rc=0} 19:12:20.192380 --- ParallelTerminationStrategy: PID 5375 died... 19:12:20.210916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5375): Terminated: ok {rc=0} 19:12:20.254001 --- ParallelTerminationStrategy: PID 5378 died... 19:12:20.272294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5378): Terminated: ok {rc=0} 19:12:20.356677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:12:21.445467 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:21.457720 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:12:21.529432 tst ping_idle_ping.py: using LAC 23121 19:12:21.648707 tst ping_idle_ping.py: using RAC 171 19:12:21.766332 tst ping_idle_ping.py: using CellId 23121 19:12:21.884283 tst ping_idle_ping.py: using BVCI 23122 19:12:21.993404 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.004310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.015315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.026091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.036684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.047423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.058399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:22.069106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:12:22.183348 tst ping_idle_ping.py:24: start network... 19:12:22.386819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:22.860155 run create_hlr_db(pid=5380): Launched 19:12:22.983926 bus /gobi_6: Setting Powered False 19:12:24.043636 run create_hlr_db(pid=5380): Terminated: ok {rc=0} 19:12:24.486127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Launched 19:12:24.811837 run osmo-hlr_10.42.42.2(pid=5383): Launched 19:12:24.934981 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:25.496543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Launched 19:12:25.820381 run osmo-stp_10.42.42.5(pid=5386): Launched 19:12:25.943741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:26.502241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Launched 19:12:26.626885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:26.901129 run patchelf(pid=5389): Launched 19:12:27.080464 run osmo-stp_10.42.42.5(pid=5386): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] 19:12:27.217196 run osmo-stp_10.42.42.5(pid=5386): stdout: | (launched: 2022-12-09_19:12:25.761320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:27.355318 run osmo-stp_10.42.42.5(pid=5386): stderr: | [0;m[38;5;43m20221209191225954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191225954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191225955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191225955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191225957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191225958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191225958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:27.493457 run osmo-stp_10.42.42.5(pid=5386): stdout: | (launched: 2022-12-09_19:12:25.761320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:27.625858 run osmo-stp_10.42.42.5(pid=5386): stderr: | [0;m[38;5;43m20221209191225954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191225954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191225955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191225955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191225957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191225958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191225958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:27.783608 run patchelf(pid=5389): Terminating (SIGINT) 19:12:27.964038 run patchelf(pid=5389): Terminated: ok {rc=0} 19:12:28.094234 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5386): Process ended prematurely: osmo-stp_10.42.42.5(pid=5386) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:12:28.103794 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:12:28.132571 run osmo-hlr_10.42.42.2(pid=5383): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5383)] 19:12:28.182574 run osmo-hlr_10.42.42.2(pid=5383): stdout: | (launched: 2022-12-09_19:12:24.752665) 19:12:28.234074 run osmo-hlr_10.42.42.2(pid=5383): stderr: | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191224954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191224966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191224974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191224974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191224974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:28.285932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Terminating (SIGTERM) 19:12:28.327617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Terminating (SIGTERM) 19:12:28.369844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Terminating (SIGTERM) 19:12:28.412069 --- ParallelTerminationStrategy: PID 5382 died... 19:12:28.431986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Terminated: ok {rc=0} 19:12:28.478312 --- ParallelTerminationStrategy: PID 5385 died... 19:12:28.497614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Terminated: ok {rc=0} 19:12:28.543937 --- ParallelTerminationStrategy: PID 5388 died... 19:12:28.563445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Terminated: ok {rc=0} 19:12:28.650980 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:12:29.960575 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:29.968335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:12:30.004041 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:12:30.039356 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:12:30.094257 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:12:30.129124 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:12:30.164447 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:12:30.723994 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:12:30.730030 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:30.741425 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:12:30.817250 tst switch_tch_pdch.py: using LAC 23122 19:12:30.961919 tst switch_tch_pdch.py: using RAC 172 19:12:31.098857 tst switch_tch_pdch.py: using CellId 23122 19:12:31.256145 tst switch_tch_pdch.py: using BVCI 23123 19:12:31.378919 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.391969 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.405383 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.418037 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.431078 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.445210 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.458660 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:12:31.472098 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:12:31.614462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:12:31.763027 tst switch_tch_pdch.py:51: start network... 19:12:31.982344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:32.457182 run create_hlr_db(pid=5393): Launched 19:12:32.581548 bus /gobi_6: Setting Powered False 19:12:33.641969 run create_hlr_db(pid=5393): Terminated: ok {rc=0} 19:12:34.084284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5395): Launched 19:12:34.407677 run osmo-hlr_10.42.42.2(pid=5396): Launched 19:12:34.531247 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:35.088610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5398): Launched 19:12:35.410336 run osmo-stp_10.42.42.5(pid=5399): Launched 19:12:35.535091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:36.085429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5404): Launched 19:12:36.200242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:36.454236 run patchelf(pid=5405): Launched 19:12:36.622909 run osmo-stp_10.42.42.5(pid=5399): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5399)] 19:12:36.749897 run osmo-stp_10.42.42.5(pid=5399): stdout: | (launched: 2022-12-09_19:12:35.351556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:36.878409 run osmo-stp_10.42.42.5(pid=5399): stderr: | [0;m[38;5;43m20221209191235545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191235545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191235546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191235546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191235546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191235546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191235547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:37.006629 run osmo-stp_10.42.42.5(pid=5399): stdout: | (launched: 2022-12-09_19:12:35.351556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:37.129458 run osmo-stp_10.42.42.5(pid=5399): stderr: | [0;m[38;5;43m20221209191235545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191235545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191235546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191235546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191235546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191235546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191235547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:37.274638 run patchelf(pid=5405): Terminating (SIGINT) 19:12:37.442123 run patchelf(pid=5405): Terminated: ok {rc=0} 19:12:37.562997 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5399): Process ended prematurely: osmo-stp_10.42.42.5(pid=5399) [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5399)] [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:12:37.571873 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 19:12:37.598291 run osmo-hlr_10.42.42.2(pid=5396): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5396)] 19:12:37.645386 run osmo-hlr_10.42.42.2(pid=5396): stdout: | (launched: 2022-12-09_19:12:34.348705) 19:12:37.694114 run osmo-hlr_10.42.42.2(pid=5396): stderr: | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191234548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191234560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191234568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191234569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191234569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:37.743253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5395): Terminating (SIGTERM) 19:12:37.782410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5398): Terminating (SIGTERM) 19:12:37.821774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5404): Terminating (SIGTERM) 19:12:37.861178 --- ParallelTerminationStrategy: PID 5395 died... 19:12:37.880112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5395): Terminated: ok {rc=0} 19:12:37.923615 --- ParallelTerminationStrategy: PID 5398 died... 19:12:37.942704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5398): Terminated: ok {rc=0} 19:12:37.986430 --- ParallelTerminationStrategy: PID 5404 died... 19:12:38.004718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5404): Terminated: ok {rc=0} 19:12:38.091069 bus /gobi_0: Setting Powered False 19:12:39.190705 bus /gobi_0: Setting Powered False 19:12:40.306122 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:12:41.557657 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:41.563789 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:12:41.597152 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:12:41.630922 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:12:41.683312 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:12:41.716549 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:12:41.750334 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:12:42.307011 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:12:42.312007 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.322974 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:12:42.391588 tst switch_tch_pdch.py: using LAC 23123 19:12:42.509347 tst switch_tch_pdch.py: using RAC 173 19:12:42.627885 tst switch_tch_pdch.py: using CellId 23123 19:12:42.748213 tst switch_tch_pdch.py: using BVCI 23124 19:12:42.859042 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.870096 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.880850 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.891839 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.902515 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.913289 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.924122 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:12:42.934863 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:12:43.055963 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:12:43.176472 tst switch_tch_pdch.py:51: start network... 19:12:43.396017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:43.870684 run create_hlr_db(pid=5409): Launched 19:12:43.997765 bus /gobi_6: Setting Powered False 19:12:45.061944 run create_hlr_db(pid=5409): Terminated: ok {rc=0} 19:12:45.469939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5411): Launched 19:12:45.772445 run osmo-hlr_10.42.42.2(pid=5412): Launched 19:12:45.929237 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:46.696759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5414): Launched 19:12:47.046714 run osmo-stp_10.42.42.5(pid=5415): Launched 19:12:47.319990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:47.864921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5417): Launched 19:12:47.988813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:48.263584 run patchelf(pid=5418): Launched 19:12:48.443157 run osmo-stp_10.42.42.5(pid=5415): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5415)] 19:12:48.580316 run osmo-stp_10.42.42.5(pid=5415): stdout: | (launched: 2022-12-09_19:12:46.985673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:48.719546 run osmo-stp_10.42.42.5(pid=5415): stderr: | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191247252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:48.858499 run osmo-stp_10.42.42.5(pid=5415): stdout: | (launched: 2022-12-09_19:12:46.985673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:48.991569 run osmo-stp_10.42.42.5(pid=5415): stderr: | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191247252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191247252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191247253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:49.149301 run patchelf(pid=5418): Terminating (SIGINT) 19:12:49.329844 run patchelf(pid=5418): Terminated: ok {rc=0} 19:12:49.459795 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5415): Process ended prematurely: osmo-stp_10.42.42.5(pid=5415) [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5415)] [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:12:49.469581 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 19:12:49.498221 run osmo-hlr_10.42.42.2(pid=5412): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5412)] 19:12:49.548725 run osmo-hlr_10.42.42.2(pid=5412): stdout: | (launched: 2022-12-09_19:12:45.716556) 19:12:49.600802 run osmo-hlr_10.42.42.2(pid=5412): stderr: | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191246018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191246044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191246054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191246054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191246054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:49.653330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5411): Terminating (SIGTERM) 19:12:49.696122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5414): Terminating (SIGTERM) 19:12:49.738655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5417): Terminating (SIGTERM) 19:12:49.781123 --- ParallelTerminationStrategy: PID 5411 died... 19:12:49.801213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5411): Terminated: ok {rc=0} 19:12:49.848156 --- ParallelTerminationStrategy: PID 5414 died... 19:12:49.867877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5414): Terminated: ok {rc=0} 19:12:49.914430 --- ParallelTerminationStrategy: PID 5417 died... 19:12:49.934144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5417): Terminated: ok {rc=0} 19:12:50.023084 bus /gobi_0: Setting Powered False 19:12:51.123019 bus /gobi_0: Setting Powered False 19:12:52.240526 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:trx-umtrx --------------------------------------------------------------------- 19:12:53.500512 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:53.504872 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:12:53.539873 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:12:53.547328 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:12:53.603214 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:12:53.635373 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:12:53.642099 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:12:54.179675 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:12:54.185590 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:12:54.196854 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:12:54.246296 tst mo_mt_sms.py: using LAC 23124 19:12:54.374649 tst mo_mt_sms.py: using RAC 174 19:12:54.505033 tst mo_mt_sms.py: using CellId 23124 19:12:54.630293 tst mo_mt_sms.py: using BVCI 23125 19:12:54.747672 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:12:54.861305 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:12:54.973735 tst mo_mt_sms.py:9: start nitb and bts... 19:12:55.177603 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:12:55.794110 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5422): Launched 19:12:56.098816 run osmo-nitb_10.42.42.2(pid=5423): Launched 19:12:56.267230 run osmo-nitb_10.42.42.2(pid=5423): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5423)] 19:12:56.402561 run osmo-nitb_10.42.42.2(pid=5423): stdout: | (launched: 2022-12-09_19:12:56.042670) 19:12:56.539386 run osmo-nitb_10.42.42.2(pid=5423): stderr: | (launched: 2022-12-09_19:12:56.088027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:12:56.676467 run osmo-nitb_10.42.42.2(pid=5423): stdout: | (launched: 2022-12-09_19:12:56.042670) 19:12:56.807363 run osmo-nitb_10.42.42.2(pid=5423): stderr: | (launched: 2022-12-09_19:12:56.088027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5423): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5423) [trial-2363↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5423)] 19:12:57.214530 tst osmo-nitb_10.42.42.2(pid=5423): stdout: | (launched: 2022-12-09_19:12:56.042670) 19:12:57.337474 tst osmo-nitb_10.42.42.2(pid=5423): stderr: | (launched: 2022-12-09_19:12:56.088027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:12:57.481926 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5423): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5423) [trial-2363↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5423)] [trial-2363↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 19:12:57.490299 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:12:57.496850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5422): Terminating (SIGTERM) 19:12:57.706681 --- ParallelTerminationStrategy: PID 5422 died... 19:12:57.727221 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5422): Terminated: ok {rc=0} 19:12:57.813065 bus /sierra_3: Setting Powered False 19:12:58.911961 bus /sierra_3: Setting Powered False 19:13:00.030023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:trx-umtrx --------------------------------------------------------------------- 19:13:01.260492 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:01.264574 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:13:01.298146 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:13:01.325141 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:13:01.377700 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:13:01.419895 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:13:01.454662 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:13:01.984659 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:13:01.993654 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.005293 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:13:02.057770 tst mo_mt_sms.py: using LAC 23125 19:13:02.206017 tst mo_mt_sms.py: using RAC 175 19:13:02.332784 tst mo_mt_sms.py: using CellId 23125 19:13:02.457654 tst mo_mt_sms.py: using BVCI 23126 19:13:02.568136 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.578891 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.589443 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.600378 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.611413 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:02.622514 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:13:02.743137 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:13:02.862444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:03.363964 run create_hlr_db(pid=5427): Launched 19:13:03.487508 bus /sierra_2: Setting Powered False 19:13:04.547666 run create_hlr_db(pid=5427): Terminated: ok {rc=0} 19:13:04.968903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Launched 19:13:05.268862 run osmo-hlr_10.42.42.2(pid=5430): Launched 19:13:05.383266 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:05.900797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5432): Launched 19:13:06.203544 run osmo-stp_10.42.42.5(pid=5433): Launched 19:13:06.318185 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:06.863591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5435): Launched 19:13:07.165253 run osmo-msc_10.42.42.6(pid=5436): Launched 19:13:07.333410 run osmo-stp_10.42.42.5(pid=5433): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5433)] 19:13:07.461192 run osmo-stp_10.42.42.5(pid=5433): stdout: | (launched: 2022-12-09_19:13:06.147054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:07.588467 run osmo-stp_10.42.42.5(pid=5433): stderr: | [0;m[38;5;43m20221209191306318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191306318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191306319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191306319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:07.713640 run osmo-stp_10.42.42.5(pid=5433): stdout: | (launched: 2022-12-09_19:13:06.147054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:07.833713 run osmo-stp_10.42.42.5(pid=5433): stderr: | [0;m[38;5;43m20221209191306318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191306318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191306319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191306319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191306321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:07.977185 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5433): Process ended prematurely: osmo-stp_10.42.42.5(pid=5433) [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5433)] [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py:16] 19:13:07.985536 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 19:13:08.011101 run osmo-hlr_10.42.42.2(pid=5430): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5430)] 19:13:08.058150 run osmo-hlr_10.42.42.2(pid=5430): stdout: | (launched: 2022-12-09_19:13:05.213705) 19:13:08.106583 run osmo-hlr_10.42.42.2(pid=5430): stderr: | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191305389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191305401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191305410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191305410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191305410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:08.174659 run osmo-msc_10.42.42.6(pid=5436): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5436)] 19:13:08.221684 run osmo-msc_10.42.42.6(pid=5436): stdout: | (launched: 2022-12-09_19:13:07.109250) 19:13:08.269876 run osmo-msc_10.42.42.6(pid=5436): stderr: | [0;m[38;5;43m20221209191307383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191307383 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2119ac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191307383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191307383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191307384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191307384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191307385 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191307386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191307386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191307386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:08.318682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Terminating (SIGTERM) 19:13:08.357563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5432): Terminating (SIGTERM) 19:13:08.396419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5435): Terminating (SIGTERM) 19:13:08.435474 --- ParallelTerminationStrategy: PID 5429 died... 19:13:08.454218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Terminated: ok {rc=0} 19:13:08.497203 --- ParallelTerminationStrategy: PID 5432 died... 19:13:08.515413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5432): Terminated: ok {rc=0} 19:13:08.558354 --- ParallelTerminationStrategy: PID 5435 died... 19:13:08.576435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5435): Terminated: ok {rc=0} 19:13:08.661082 bus /sierra_3: Setting Powered False 19:13:09.761088 bus /sierra_3: Setting Powered False 19:13:10.872710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 19:13:12.101699 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:12.106040 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:13:12.140453 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:13:12.147909 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:13:12.187555 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:13:12.222766 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:13:12.229999 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:13:12.742684 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:13:12.747557 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:13:12.758225 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:13:12.805466 tst assert_extension.py: using LAC 23126 19:13:12.933218 tst assert_extension.py: using RAC 176 19:13:13.060228 tst assert_extension.py: using CellId 23126 19:13:13.186743 tst assert_extension.py: using BVCI 23127 19:13:13.306024 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:13:13.421085 tst assert_extension.py:10: start nitb and bts... 19:13:13.625073 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:13:14.243070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5441): Launched 19:13:14.542854 run osmo-nitb_10.42.42.2(pid=5442): Launched 19:13:14.708670 run osmo-nitb_10.42.42.2(pid=5442): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5442)] 19:13:14.843153 run osmo-nitb_10.42.42.2(pid=5442): stdout: | (launched: 2022-12-09_19:13:14.487182) 19:13:14.979058 run osmo-nitb_10.42.42.2(pid=5442): stderr: | (launched: 2022-12-09_19:13:14.531977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:13:15.115210 run osmo-nitb_10.42.42.2(pid=5442): stdout: | (launched: 2022-12-09_19:13:14.487182) 19:13:15.245634 run osmo-nitb_10.42.42.2(pid=5442): stderr: | (launched: 2022-12-09_19:13:14.531977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5442): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5442) [trial-2363↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5442)] 19:13:15.656290 tst osmo-nitb_10.42.42.2(pid=5442): stdout: | (launched: 2022-12-09_19:13:14.487182) 19:13:15.778209 tst osmo-nitb_10.42.42.2(pid=5442): stderr: | (launched: 2022-12-09_19:13:14.531977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:13:15.965144 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5442): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5442) [trial-2363↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5442)] [trial-2363↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 19:13:15.975210 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:13:15.983417 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5441): Terminating (SIGTERM) 19:13:16.203473 --- ParallelTerminationStrategy: PID 5441 died... 19:13:16.223187 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5441): Terminated: ok {rc=0} 19:13:16.310187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:trx-umtrx --------------------------------------------------------------------- 19:13:17.488937 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:17.493458 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:13:17.527846 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:13:17.555499 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:13:17.595993 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:13:17.629327 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:13:17.655408 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:13:18.181443 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:13:18.186841 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.197987 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:13:18.246086 tst assert_extension.py: using LAC 23127 19:13:18.373820 tst assert_extension.py: using RAC 177 19:13:18.499224 tst assert_extension.py: using CellId 23127 19:13:18.623568 tst assert_extension.py: using BVCI 23128 19:13:18.741218 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.752203 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.763097 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.774253 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.785492 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:13:18.796453 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:13:18.911079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:19.379539 run create_hlr_db(pid=5446): Launched 19:13:19.503412 bus /sierra_2: Setting Powered False 19:13:20.563451 run create_hlr_db(pid=5446): Terminated: ok {rc=0} 19:13:20.984655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5448): Launched 19:13:21.286094 run osmo-hlr_10.42.42.2(pid=5449): Launched 19:13:21.400339 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:21.925047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5451): Launched 19:13:22.226877 run osmo-stp_10.42.42.5(pid=5452): Launched 19:13:22.342542 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:22.887095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5454): Launched 19:13:23.189765 run osmo-msc_10.42.42.6(pid=5455): Launched 19:13:23.358024 run osmo-stp_10.42.42.5(pid=5452): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5452)] 19:13:23.485475 run osmo-stp_10.42.42.5(pid=5452): stdout: | (launched: 2022-12-09_19:13:22.170906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:23.612293 run osmo-stp_10.42.42.5(pid=5452): stderr: | [0;m[38;5;43m20221209191322341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191322341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191322342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191322342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:23.737409 run osmo-stp_10.42.42.5(pid=5452): stdout: | (launched: 2022-12-09_19:13:22.170906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:23.857486 run osmo-stp_10.42.42.5(pid=5452): stderr: | [0;m[38;5;43m20221209191322341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191322341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191322342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191322342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191322345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:24.001156 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5452): Process ended prematurely: osmo-stp_10.42.42.5(pid=5452) [trial-2363↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5452)] [trial-2363↪ussd:trx-umtrx↪assert_extension.py:17] 19:13:24.009745 tst assert_extension.py:17: Test FAILED (5.8 sec) 19:13:24.036809 run osmo-hlr_10.42.42.2(pid=5449): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5449)] 19:13:24.084379 run osmo-hlr_10.42.42.2(pid=5449): stdout: | (launched: 2022-12-09_19:13:21.230482) 19:13:24.133317 run osmo-hlr_10.42.42.2(pid=5449): stderr: | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191321406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191321419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191321428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191321428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191321428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:24.201533 run osmo-msc_10.42.42.6(pid=5455): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5455)] 19:13:24.248630 run osmo-msc_10.42.42.6(pid=5455): stdout: | (launched: 2022-12-09_19:13:23.133979) 19:13:24.297496 run osmo-msc_10.42.42.6(pid=5455): stderr: | [0;m[38;5;43m20221209191323408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191323408 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7eb4620c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191323408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191323408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191323409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191323409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191323411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191323411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191323411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191323411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:24.347220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5448): Terminating (SIGTERM) 19:13:24.386477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5451): Terminating (SIGTERM) 19:13:24.425589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5454): Terminating (SIGTERM) 19:13:24.465228 --- ParallelTerminationStrategy: PID 5448 died... 19:13:24.484105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5448): Terminated: ok {rc=0} 19:13:24.527730 --- ParallelTerminationStrategy: PID 5451 died... 19:13:24.546170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5451): Terminated: ok {rc=0} 19:13:24.589330 --- ParallelTerminationStrategy: PID 5454 died... 19:13:24.607838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5454): Terminated: ok {rc=0} 19:13:24.691941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:13:25.905483 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:25.912349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:13:25.944810 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:13:25.971363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:13:26.021059 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:13:26.052879 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:13:26.078823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:13:26.632838 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:13:26.682386 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:26.693434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:13:26.760810 tst mo_mt_call.py: using LAC 23128 19:13:26.879018 tst mo_mt_call.py: using RAC 178 19:13:26.999025 tst mo_mt_call.py: using CellId 23128 19:13:27.119623 tst mo_mt_call.py: using BVCI 23129 19:13:27.231902 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:27.242948 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:27.253846 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:27.264570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:27.275401 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:27.286248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:13:27.405891 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:13:27.525619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:28.037020 run create_hlr_db(pid=5461): Launched 19:13:28.163330 bus /sierra_2: Setting Powered False 19:13:29.228268 run create_hlr_db(pid=5461): Terminated: ok {rc=0} 19:13:29.687264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5463): Launched 19:13:30.018642 run osmo-hlr_10.42.42.2(pid=5464): Launched 19:13:30.145075 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:30.712785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5466): Launched 19:13:31.065788 run osmo-stp_10.42.42.5(pid=5467): Launched 19:13:31.243257 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:31.974687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5469): Launched 19:13:32.335199 run osmo-msc_10.42.42.6(pid=5470): Launched 19:13:32.520349 run osmo-stp_10.42.42.5(pid=5467): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5467)] 19:13:32.659796 run osmo-stp_10.42.42.5(pid=5467): stdout: | (launched: 2022-12-09_19:13:31.005373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:32.799933 run osmo-stp_10.42.42.5(pid=5467): stderr: | [0;m[38;5;43m20221209191331386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191331386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191331387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191331387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:32.931363 run osmo-stp_10.42.42.5(pid=5467): stdout: | (launched: 2022-12-09_19:13:31.005373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:33.054243 run osmo-stp_10.42.42.5(pid=5467): stderr: | [0;m[38;5;43m20221209191331386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191331386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191331387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191331387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191331388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:33.200702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5467): Process ended prematurely: osmo-stp_10.42.42.5(pid=5467) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5467)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:13:33.209935 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 19:13:33.236579 run osmo-hlr_10.42.42.2(pid=5464): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5464)] 19:13:33.284517 run osmo-hlr_10.42.42.2(pid=5464): stdout: | (launched: 2022-12-09_19:13:29.958872) 19:13:33.334132 run osmo-hlr_10.42.42.2(pid=5464): stderr: | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191330157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191330168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191330177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191330177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191330177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:33.403650 run osmo-msc_10.42.42.6(pid=5470): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5470)] 19:13:33.451556 run osmo-msc_10.42.42.6(pid=5470): stdout: | (launched: 2022-12-09_19:13:32.274718) 19:13:33.501214 run osmo-msc_10.42.42.6(pid=5470): stderr: | [0;m[38;5;43m20221209191332598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191332599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ffddc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191332599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191332599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191332599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191332599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191332601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191332601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191332602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191332602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:33.551165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5463): Terminating (SIGTERM) 19:13:33.591560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5466): Terminating (SIGTERM) 19:13:33.631731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5469): Terminating (SIGTERM) 19:13:33.672080 --- ParallelTerminationStrategy: PID 5463 died... 19:13:33.691281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5463): Terminated: ok {rc=0} 19:13:33.735639 --- ParallelTerminationStrategy: PID 5466 died... 19:13:33.754380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5466): Terminated: ok {rc=0} 19:13:33.798531 --- ParallelTerminationStrategy: PID 5469 died... 19:13:33.817322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5469): Terminated: ok {rc=0} 19:13:33.903796 bus /sierra_3: Setting Powered False 19:13:35.004223 bus /sierra_3: Setting Powered False 19:13:36.120498 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:13:37.268434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.280171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:13:37.349248 tst mo_mt_call_osmux.py: using LAC 23129 19:13:37.471767 tst mo_mt_call_osmux.py: using RAC 179 19:13:37.592832 tst mo_mt_call_osmux.py: using CellId 23129 19:13:37.711616 tst mo_mt_call_osmux.py: using BVCI 23130 19:13:37.823467 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.834490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.845307 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.856009 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.866854 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:13:37.877605 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:13:37.995903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:13:38.111277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:38.588313 run create_hlr_db(pid=5472): Launched 19:13:38.712490 bus /sierra_2: Setting Powered False 19:13:39.773870 run create_hlr_db(pid=5472): Terminated: ok {rc=0} 19:13:40.223340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5474): Launched 19:13:40.553716 run osmo-hlr_10.42.42.2(pid=5475): Launched 19:13:40.679712 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:41.245374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5477): Launched 19:13:41.573464 run osmo-stp_10.42.42.5(pid=5478): Launched 19:13:41.700330 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:42.294825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5480): Launched 19:13:42.625797 run osmo-msc_10.42.42.6(pid=5481): Launched 19:13:42.811247 run osmo-stp_10.42.42.5(pid=5478): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5478)] 19:13:42.950200 run osmo-stp_10.42.42.5(pid=5478): stdout: | (launched: 2022-12-09_19:13:41.513500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:43.090152 run osmo-stp_10.42.42.5(pid=5478): stderr: | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191341707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:43.226830 run osmo-stp_10.42.42.5(pid=5478): stdout: | (launched: 2022-12-09_19:13:41.513500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:43.357501 run osmo-stp_10.42.42.5(pid=5478): stderr: | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191341706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191341707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191341709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:43.514036 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5478): Process ended prematurely: osmo-stp_10.42.42.5(pid=5478) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5478)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:13:43.523766 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:13:43.552086 run osmo-hlr_10.42.42.2(pid=5475): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5475)] 19:13:43.601755 run osmo-hlr_10.42.42.2(pid=5475): stdout: | (launched: 2022-12-09_19:13:40.493887) 19:13:43.653184 run osmo-hlr_10.42.42.2(pid=5475): stderr: | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191340694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191340707 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191340715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191340715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191340715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:43.724804 run osmo-msc_10.42.42.6(pid=5481): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5481)] 19:13:43.774336 run osmo-msc_10.42.42.6(pid=5481): stdout: | (launched: 2022-12-09_19:13:42.565569) 19:13:43.825480 run osmo-msc_10.42.42.6(pid=5481): stderr: | [0;m[38;5;43m20221209191342886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191342886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f39c2086c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191342886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191342886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191342886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191342887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191342890 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191342891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191342891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191342891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:43.877038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5474): Terminating (SIGTERM) 19:13:43.918309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5477): Terminating (SIGTERM) 19:13:43.959887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5480): Terminating (SIGTERM) 19:13:44.001708 --- ParallelTerminationStrategy: PID 5474 died... 19:13:44.021602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5474): Terminated: ok {rc=0} 19:13:44.068076 --- ParallelTerminationStrategy: PID 5477 died... 19:13:44.087554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5477): Terminated: ok {rc=0} 19:13:44.133550 --- ParallelTerminationStrategy: PID 5480 died... 19:13:44.153000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5480): Terminated: ok {rc=0} 19:13:44.240784 bus /sierra_3: Setting Powered False 19:13:45.336696 bus /sierra_3: Setting Powered False 19:13:46.458121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:13:47.718305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:47.726020 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:13:47.758152 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:13:47.784248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:13:47.835514 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:13:47.867512 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:13:47.893642 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:13:48.444603 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:13:48.494136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:48.505149 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:13:48.572920 tst mo_mt_call.py: using LAC 23130 19:13:48.692854 tst mo_mt_call.py: using RAC 180 19:13:48.815485 tst mo_mt_call.py: using CellId 23130 19:13:48.936435 tst mo_mt_call.py: using BVCI 23131 19:13:49.057445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:49.069121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:49.080573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:49.092566 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:49.104559 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:49.116451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:13:49.231868 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:13:49.349974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:49.858795 run create_hlr_db(pid=5486): Launched 19:13:49.984667 bus /sierra_2: Setting Powered False 19:13:51.050176 run create_hlr_db(pid=5486): Terminated: ok {rc=0} 19:13:51.488092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5488): Launched 19:13:51.795326 run osmo-hlr_10.42.42.2(pid=5489): Launched 19:13:51.912111 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:52.438978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5491): Launched 19:13:52.745743 run osmo-stp_10.42.42.5(pid=5492): Launched 19:13:52.862254 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:53.415358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5494): Launched 19:13:53.721276 run osmo-msc_10.42.42.6(pid=5495): Launched 19:13:53.892151 run osmo-stp_10.42.42.5(pid=5492): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5492)] 19:13:54.021787 run osmo-stp_10.42.42.5(pid=5492): stdout: | (launched: 2022-12-09_19:13:52.689291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:54.151001 run osmo-stp_10.42.42.5(pid=5492): stderr: | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191352862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:54.277940 run osmo-stp_10.42.42.5(pid=5492): stdout: | (launched: 2022-12-09_19:13:52.689291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:54.399788 run osmo-stp_10.42.42.5(pid=5492): stderr: | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191352861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191352862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191352862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:54.545824 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5492): Process ended prematurely: osmo-stp_10.42.42.5(pid=5492) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5492)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:13:54.554747 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:13:54.581067 run osmo-hlr_10.42.42.2(pid=5489): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5489)] 19:13:54.628035 run osmo-hlr_10.42.42.2(pid=5489): stdout: | (launched: 2022-12-09_19:13:51.738965) 19:13:54.676575 run osmo-hlr_10.42.42.2(pid=5489): stderr: | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191351915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191351927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191351935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191351935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191351935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:54.745194 run osmo-msc_10.42.42.6(pid=5495): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5495)] 19:13:54.792171 run osmo-msc_10.42.42.6(pid=5495): stdout: | (launched: 2022-12-09_19:13:53.664600) 19:13:54.840762 run osmo-msc_10.42.42.6(pid=5495): stderr: | [0;m[38;5;43m20221209191353938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191353938 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2756a5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191353938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191353938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191353938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191353938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191353940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191353940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191353940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191353941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:54.889829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5488): Terminating (SIGTERM) 19:13:54.929063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5491): Terminating (SIGTERM) 19:13:54.967865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5494): Terminating (SIGTERM) 19:13:55.007323 --- ParallelTerminationStrategy: PID 5488 died... 19:13:55.026112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5488): Terminated: ok {rc=0} 19:13:55.069326 --- ParallelTerminationStrategy: PID 5491 died... 19:13:55.087783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5491): Terminated: ok {rc=0} 19:13:55.131334 --- ParallelTerminationStrategy: PID 5494 died... 19:13:55.149936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5494): Terminated: ok {rc=0} 19:13:55.233703 bus /sierra_3: Setting Powered False 19:13:56.331321 bus /sierra_3: Setting Powered False 19:13:57.450831 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:13:58.597136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:58.608877 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:13:58.677427 tst mo_mt_call_osmux.py: using LAC 23131 19:13:58.797847 tst mo_mt_call_osmux.py: using RAC 181 19:13:58.918800 tst mo_mt_call_osmux.py: using CellId 23131 19:13:59.041513 tst mo_mt_call_osmux.py: using BVCI 23132 19:13:59.152706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:59.163913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:59.174870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:59.185773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:59.196655 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:13:59.207610 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:13:59.322763 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:13:59.447179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:59.956667 run create_hlr_db(pid=5497): Launched 19:14:00.083641 bus /sierra_2: Setting Powered False 19:14:01.145507 run create_hlr_db(pid=5497): Terminated: ok {rc=0} 19:14:01.587741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5499): Launched 19:14:01.915679 run osmo-hlr_10.42.42.2(pid=5500): Launched 19:14:02.166622 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:02.716694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5502): Launched 19:14:03.023805 run osmo-stp_10.42.42.5(pid=5503): Launched 19:14:03.140437 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:03.694373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5505): Launched 19:14:04.002579 run osmo-msc_10.42.42.6(pid=5506): Launched 19:14:04.175146 run osmo-stp_10.42.42.5(pid=5503): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5503)] 19:14:04.303811 run osmo-stp_10.42.42.5(pid=5503): stdout: | (launched: 2022-12-09_19:14:02.967390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:04.432894 run osmo-stp_10.42.42.5(pid=5503): stderr: | [0;m[38;5;43m20221209191403139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191403139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191403140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191403140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:04.560020 run osmo-stp_10.42.42.5(pid=5503): stdout: | (launched: 2022-12-09_19:14:02.967390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:04.682695 run osmo-stp_10.42.42.5(pid=5503): stderr: | [0;m[38;5;43m20221209191403139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191403139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191403140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191403140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191403141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:04.828569 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5503): Process ended prematurely: osmo-stp_10.42.42.5(pid=5503) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5503)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:14:04.837475 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:14:04.863549 run osmo-hlr_10.42.42.2(pid=5500): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5500)] 19:14:04.910277 run osmo-hlr_10.42.42.2(pid=5500): stdout: | (launched: 2022-12-09_19:14:01.857666) 19:14:04.958645 run osmo-hlr_10.42.42.2(pid=5500): stderr: | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191402161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191402181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191402189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191402189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191402189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:05.033015 run osmo-msc_10.42.42.6(pid=5506): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5506)] 19:14:05.083264 run osmo-msc_10.42.42.6(pid=5506): stdout: | (launched: 2022-12-09_19:14:03.946124) 19:14:05.135065 run osmo-msc_10.42.42.6(pid=5506): stderr: | [0;m[38;5;43m20221209191404218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191404218 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ae5de9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191404218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191404218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191404218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191404219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191404220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191404221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191404221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191404221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:05.186976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5499): Terminating (SIGTERM) 19:14:05.229364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5502): Terminating (SIGTERM) 19:14:05.271387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5505): Terminating (SIGTERM) 19:14:05.313500 --- ParallelTerminationStrategy: PID 5499 died... 19:14:05.333210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5499): Terminated: ok {rc=0} 19:14:05.380369 --- ParallelTerminationStrategy: PID 5502 died... 19:14:05.399847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5502): Terminated: ok {rc=0} 19:14:05.446604 --- ParallelTerminationStrategy: PID 5505 died... 19:14:05.466142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5505): Terminated: ok {rc=0} 19:14:05.554513 bus /sierra_3: Setting Powered False 19:14:06.653631 bus /sierra_3: Setting Powered False 19:14:07.770022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:14:09.019561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:09.026497 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:14:09.060226 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:14:09.087514 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:14:09.140090 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:14:09.173434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:14:09.200840 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:14:09.752793 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:14:09.803967 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:09.815126 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:14:09.882826 tst mo_mt_call.py: using LAC 23132 19:14:10.004687 tst mo_mt_call.py: using RAC 182 19:14:10.124169 tst mo_mt_call.py: using CellId 23132 19:14:10.249095 tst mo_mt_call.py: using BVCI 23133 19:14:10.360823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:10.371823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:10.382556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:10.393552 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:10.404322 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:10.415245 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:14:10.532732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:14:10.651835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:11.162504 run create_hlr_db(pid=5512): Launched 19:14:11.287303 bus /sierra_2: Setting Powered False 19:14:12.352215 run create_hlr_db(pid=5512): Terminated: ok {rc=0} 19:14:12.790736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5514): Launched 19:14:13.098421 run osmo-hlr_10.42.42.2(pid=5515): Launched 19:14:13.215198 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:13.743426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5517): Launched 19:14:14.049947 run osmo-stp_10.42.42.5(pid=5518): Launched 19:14:14.166632 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:14.720613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5520): Launched 19:14:15.027240 run osmo-msc_10.42.42.6(pid=5521): Launched 19:14:15.198158 run osmo-stp_10.42.42.5(pid=5518): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5518)] 19:14:15.332470 run osmo-stp_10.42.42.5(pid=5518): stdout: | (launched: 2022-12-09_19:14:13.993647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:15.461833 run osmo-stp_10.42.42.5(pid=5518): stderr: | [0;m[38;5;43m20221209191414167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191414167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191414168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191414168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191414168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191414169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191414169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:15.590095 run osmo-stp_10.42.42.5(pid=5518): stdout: | (launched: 2022-12-09_19:14:13.993647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:15.712317 run osmo-stp_10.42.42.5(pid=5518): stderr: | [0;m[38;5;43m20221209191414167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191414167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191414168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191414168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191414168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191414169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191414169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:15.872010 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5518): Process ended prematurely: osmo-stp_10.42.42.5(pid=5518) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5518)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:14:15.882791 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:14:15.915963 run osmo-hlr_10.42.42.2(pid=5515): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5515)] 19:14:15.969622 run osmo-hlr_10.42.42.2(pid=5515): stdout: | (launched: 2022-12-09_19:14:13.041604) 19:14:16.024132 run osmo-hlr_10.42.42.2(pid=5515): stderr: | [0;m[1;31m20221209191413220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191413220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191413220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191413221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191413221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191413221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191413233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191413242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191413242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191413242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:16.099044 run osmo-msc_10.42.42.6(pid=5521): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5521)] 19:14:16.153178 run osmo-msc_10.42.42.6(pid=5521): stdout: | (launched: 2022-12-09_19:14:14.970696) 19:14:16.206965 run osmo-msc_10.42.42.6(pid=5521): stderr: | [0;m[38;5;43m20221209191415249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191415249 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecc9ce7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191415249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191415249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191415249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191415250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191415251 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191415252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191415252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191415252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:16.261402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5514): Terminating (SIGTERM) 19:14:16.305703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5517): Terminating (SIGTERM) 19:14:16.352699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5520): Terminating (SIGTERM) 19:14:16.399007 --- ParallelTerminationStrategy: PID 5514 died... 19:14:16.419667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5514): Terminated: ok {rc=0} 19:14:16.469957 --- ParallelTerminationStrategy: PID 5517 died... 19:14:16.490402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5517): Terminated: ok {rc=0} 19:14:16.539743 --- ParallelTerminationStrategy: PID 5520 died... 19:14:16.561513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5520): Terminated: ok {rc=0} 19:14:16.659207 bus /sierra_3: Setting Powered False 19:14:17.773428 bus /sierra_3: Setting Powered False 19:14:18.891227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:14:20.036933 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.048836 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:14:20.118299 tst mo_mt_call_osmux.py: using LAC 23133 19:14:20.238460 tst mo_mt_call_osmux.py: using RAC 183 19:14:20.357279 tst mo_mt_call_osmux.py: using CellId 23133 19:14:20.479997 tst mo_mt_call_osmux.py: using BVCI 23134 19:14:20.592601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.603716 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.614592 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.625767 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.636832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:14:20.647964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:14:20.767464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:14:20.884556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:21.359479 run create_hlr_db(pid=5523): Launched 19:14:21.484421 bus /sierra_2: Setting Powered False 19:14:22.545287 run create_hlr_db(pid=5523): Terminated: ok {rc=0} 19:14:22.974027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5525): Launched 19:14:23.281672 run osmo-hlr_10.42.42.2(pid=5526): Launched 19:14:23.398352 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:23.930212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5528): Launched 19:14:24.237212 run osmo-stp_10.42.42.5(pid=5529): Launched 19:14:24.353992 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:24.908563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5531): Launched 19:14:25.216083 run osmo-msc_10.42.42.6(pid=5532): Launched 19:14:25.386199 run osmo-stp_10.42.42.5(pid=5529): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5529)] 19:14:25.519791 run osmo-stp_10.42.42.5(pid=5529): stdout: | (launched: 2022-12-09_19:14:24.180602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:25.649067 run osmo-stp_10.42.42.5(pid=5529): stderr: | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191424356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:25.776766 run osmo-stp_10.42.42.5(pid=5529): stdout: | (launched: 2022-12-09_19:14:24.180602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:25.898541 run osmo-stp_10.42.42.5(pid=5529): stderr: | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191424355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191424356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191424356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:26.044150 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5529): Process ended prematurely: osmo-stp_10.42.42.5(pid=5529) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5529)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:14:26.053291 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:14:26.079926 run osmo-hlr_10.42.42.2(pid=5526): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5526)] 19:14:26.127409 run osmo-hlr_10.42.42.2(pid=5526): stdout: | (launched: 2022-12-09_19:14:23.225430) 19:14:26.176720 run osmo-hlr_10.42.42.2(pid=5526): stderr: | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191423402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191423414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191423423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191423423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191423423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:26.244894 run osmo-msc_10.42.42.6(pid=5532): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5532)] 19:14:26.292179 run osmo-msc_10.42.42.6(pid=5532): stdout: | (launched: 2022-12-09_19:14:25.159416) 19:14:26.340760 run osmo-msc_10.42.42.6(pid=5532): stderr: | [0;m[38;5;43m20221209191425433 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191425433 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb364aabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191425433 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191425434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191425434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191425434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191425438 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191425439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191425439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191425439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:26.389732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5525): Terminating (SIGTERM) 19:14:26.428780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5528): Terminating (SIGTERM) 19:14:26.468024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5531): Terminating (SIGTERM) 19:14:26.507568 --- ParallelTerminationStrategy: PID 5525 died... 19:14:26.526492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5525): Terminated: ok {rc=0} 19:14:26.569662 --- ParallelTerminationStrategy: PID 5528 died... 19:14:26.588004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5528): Terminated: ok {rc=0} 19:14:26.631043 --- ParallelTerminationStrategy: PID 5531 died... 19:14:26.649256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5531): Terminated: ok {rc=0} 19:14:26.733231 bus /sierra_3: Setting Powered False 19:14:27.833826 bus /sierra_3: Setting Powered False 19:14:28.950391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:14:30.203681 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:30.211804 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:14:30.244108 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:14:30.270556 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:14:30.319837 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:14:30.352100 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:14:30.378330 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:14:30.969484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:14:31.029681 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.043278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:14:31.122411 tst mo_mt_call.py: using LAC 23134 19:14:31.284824 tst mo_mt_call.py: using RAC 184 19:14:31.437964 tst mo_mt_call.py: using CellId 23134 19:14:31.607417 tst mo_mt_call.py: using BVCI 23135 19:14:31.723884 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.735807 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.747450 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.759144 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.770884 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:31.782545 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:14:31.902996 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:14:32.023928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:32.518410 run create_hlr_db(pid=5537): Launched 19:14:32.646156 bus /sierra_2: Setting Powered False 19:14:33.710798 run create_hlr_db(pid=5537): Terminated: ok {rc=0} 19:14:34.168214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5539): Launched 19:14:34.497590 run osmo-hlr_10.42.42.2(pid=5540): Launched 19:14:34.625419 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:35.195184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Launched 19:14:35.525027 run osmo-stp_10.42.42.5(pid=5543): Launched 19:14:35.650931 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:36.248125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5545): Launched 19:14:36.579614 run osmo-msc_10.42.42.6(pid=5546): Launched 19:14:36.764539 run osmo-stp_10.42.42.5(pid=5543): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] 19:14:36.903765 run osmo-stp_10.42.42.5(pid=5543): stdout: | (launched: 2022-12-09_19:14:35.464904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:37.043405 run osmo-stp_10.42.42.5(pid=5543): stderr: | [0;m[38;5;43m20221209191435657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191435658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191435658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191435658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191435660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191435661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191435661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:37.181517 run osmo-stp_10.42.42.5(pid=5543): stdout: | (launched: 2022-12-09_19:14:35.464904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:37.312021 run osmo-stp_10.42.42.5(pid=5543): stderr: | [0;m[38;5;43m20221209191435657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191435658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191435658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191435658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191435660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191435661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191435661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:37.468694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5543): Process ended prematurely: osmo-stp_10.42.42.5(pid=5543) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:14:37.478393 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:14:37.506563 run osmo-hlr_10.42.42.2(pid=5540): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5540)] 19:14:37.556224 run osmo-hlr_10.42.42.2(pid=5540): stdout: | (launched: 2022-12-09_19:14:34.437623) 19:14:37.607415 run osmo-hlr_10.42.42.2(pid=5540): stderr: | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191434639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191434652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191434660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191434660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191434660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:37.678440 run osmo-msc_10.42.42.6(pid=5546): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5546)] 19:14:37.728367 run osmo-msc_10.42.42.6(pid=5546): stdout: | (launched: 2022-12-09_19:14:36.519283) 19:14:37.779668 run osmo-msc_10.42.42.6(pid=5546): stderr: | [0;m[38;5;43m20221209191436843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191436843 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95286d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191436843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191436843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191436843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191436843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191436845 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191436845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191436846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191436846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:37.831303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5539): Terminating (SIGTERM) 19:14:37.872498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Terminating (SIGTERM) 19:14:37.913727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5545): Terminating (SIGTERM) 19:14:37.955151 --- ParallelTerminationStrategy: PID 5539 died... 19:14:37.974833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5539): Terminated: ok {rc=0} 19:14:38.020788 --- ParallelTerminationStrategy: PID 5542 died... 19:14:38.040167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Terminated: ok {rc=0} 19:14:38.086010 --- ParallelTerminationStrategy: PID 5545 died... 19:14:38.105397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5545): Terminated: ok {rc=0} 19:14:38.192522 bus /sierra_3: Setting Powered False 19:14:39.291210 bus /sierra_3: Setting Powered False 19:14:40.409404 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:14:41.554188 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:41.566114 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:14:41.634548 tst mo_mt_call_osmux.py: using LAC 23135 19:14:41.756664 tst mo_mt_call_osmux.py: using RAC 185 19:14:41.878429 tst mo_mt_call_osmux.py: using CellId 23135 19:14:42.001439 tst mo_mt_call_osmux.py: using BVCI 23136 19:14:42.113664 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:42.124520 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:42.135410 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:42.146417 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:42.157482 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:14:42.168352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:14:42.287467 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:14:42.404885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:42.883745 run create_hlr_db(pid=5548): Launched 19:14:43.009161 bus /sierra_2: Setting Powered False 19:14:44.070447 run create_hlr_db(pid=5548): Terminated: ok {rc=0} 19:14:44.520332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5550): Launched 19:14:44.853535 run osmo-hlr_10.42.42.2(pid=5551): Launched 19:14:44.981700 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:45.551369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5553): Launched 19:14:45.885692 run osmo-stp_10.42.42.5(pid=5554): Launched 19:14:46.114962 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:46.753701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5556): Launched 19:14:47.094998 run osmo-msc_10.42.42.6(pid=5557): Launched 19:14:47.432341 run osmo-stp_10.42.42.5(pid=5554): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5554)] 19:14:47.571557 run osmo-stp_10.42.42.5(pid=5554): stdout: | (launched: 2022-12-09_19:14:45.822469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:47.711952 run osmo-stp_10.42.42.5(pid=5554): stderr: | [0;m[38;5;43m20221209191446098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191446098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191446099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191446099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191446099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191446100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191446100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:47.850430 run osmo-stp_10.42.42.5(pid=5554): stdout: | (launched: 2022-12-09_19:14:45.822469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:47.982223 run osmo-stp_10.42.42.5(pid=5554): stderr: | [0;m[38;5;43m20221209191446098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191446098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191446099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191446099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191446099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191446100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191446100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:48.139799 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5554): Process ended prematurely: osmo-stp_10.42.42.5(pid=5554) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5554)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:14:48.149839 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:14:48.178650 run osmo-hlr_10.42.42.2(pid=5551): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5551)] 19:14:48.229369 run osmo-hlr_10.42.42.2(pid=5551): stdout: | (launched: 2022-12-09_19:14:44.793401) 19:14:48.281947 run osmo-hlr_10.42.42.2(pid=5551): stderr: | [0;m[1;31m20221209191444994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191444994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191444995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191444995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191444995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191444995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191445007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191445015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191445015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191445015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:48.355302 run osmo-msc_10.42.42.6(pid=5557): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5557)] 19:14:48.406016 run osmo-msc_10.42.42.6(pid=5557): stdout: | (launched: 2022-12-09_19:14:47.033148) 19:14:48.458570 run osmo-msc_10.42.42.6(pid=5557): stderr: | [0;m[38;5;43m20221209191447454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191447454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00541c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191447454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191447455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191447455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191447455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191447457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191447457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191447457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191447457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:48.511354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5550): Terminating (SIGTERM) 19:14:48.553752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5553): Terminating (SIGTERM) 19:14:48.596061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5556): Terminating (SIGTERM) 19:14:48.638688 --- ParallelTerminationStrategy: PID 5550 died... 19:14:48.658778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5550): Terminated: ok {rc=0} 19:14:48.705702 --- ParallelTerminationStrategy: PID 5553 died... 19:14:48.725705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5553): Terminated: ok {rc=0} 19:14:48.772385 --- ParallelTerminationStrategy: PID 5556 died... 19:14:48.792134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5556): Terminated: ok {rc=0} 19:14:48.880829 bus /sierra_3: Setting Powered False 19:14:49.978882 bus /sierra_3: Setting Powered False 19:14:51.093982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:14:52.343489 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:52.350620 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:14:52.385843 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:14:52.413840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:14:52.467156 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:14:52.500773 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:14:52.528605 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:14:53.079002 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:14:53.132648 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.144168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:14:53.215571 tst mo_mt_call.py: using LAC 23136 19:14:53.337519 tst mo_mt_call.py: using RAC 186 19:14:53.467487 tst mo_mt_call.py: using CellId 23136 19:14:53.594761 tst mo_mt_call.py: using BVCI 23137 19:14:53.714720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.726519 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.737937 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.749480 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.760932 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:14:53.772672 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:14:53.889562 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:14:54.008335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:54.486837 run create_hlr_db(pid=5562): Launched 19:14:54.614536 bus /sierra_2: Setting Powered False 19:14:55.675074 run create_hlr_db(pid=5562): Terminated: ok {rc=0} 19:14:56.123901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Launched 19:14:56.452497 run osmo-hlr_10.42.42.2(pid=5565): Launched 19:14:56.577944 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:57.146691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Launched 19:14:57.476364 run osmo-stp_10.42.42.5(pid=5568): Launched 19:14:57.601115 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:58.193803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5570): Launched 19:14:58.521430 run osmo-msc_10.42.42.6(pid=5571): Launched 19:14:58.705207 run osmo-stp_10.42.42.5(pid=5568): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] 19:14:58.847513 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-09_19:14:57.416383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:58.982999 run osmo-stp_10.42.42.5(pid=5568): stderr: | [0;m[38;5;43m20221209191457612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191457612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191457613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191457613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:59.119494 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-09_19:14:57.416383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:59.250293 run osmo-stp_10.42.42.5(pid=5568): stderr: | [0;m[38;5;43m20221209191457612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191457612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191457613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191457613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191457614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:59.406482 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:14:59.416311 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:14:59.444129 run osmo-hlr_10.42.42.2(pid=5565): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5565)] 19:14:59.494059 run osmo-hlr_10.42.42.2(pid=5565): stdout: | (launched: 2022-12-09_19:14:56.392522) 19:14:59.545485 run osmo-hlr_10.42.42.2(pid=5565): stderr: | [0;m[1;31m20221209191456594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191456594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191456594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191456594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191456595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191456595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191456607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191456616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191456616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191456616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:59.617128 run osmo-msc_10.42.42.6(pid=5571): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5571)] 19:14:59.666810 run osmo-msc_10.42.42.6(pid=5571): stdout: | (launched: 2022-12-09_19:14:58.461531) 19:14:59.718069 run osmo-msc_10.42.42.6(pid=5571): stderr: | [0;m[38;5;43m20221209191458788 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191458788 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f398c2c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191458788 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191458788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191458788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191458789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191458790 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191458791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191458791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191458791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:59.769853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminating (SIGTERM) 19:14:59.811281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminating (SIGTERM) 19:14:59.852772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5570): Terminating (SIGTERM) 19:14:59.894929 --- ParallelTerminationStrategy: PID 5564 died... 19:14:59.914640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminated: ok {rc=0} 19:14:59.960909 --- ParallelTerminationStrategy: PID 5567 died... 19:14:59.980343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminated: ok {rc=0} 19:15:00.026452 --- ParallelTerminationStrategy: PID 5570 died... 19:15:00.045871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5570): Terminated: ok {rc=0} 19:15:00.134097 bus /sierra_3: Setting Powered False 19:15:01.236097 bus /sierra_3: Setting Powered False 19:15:02.354330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:15:03.506986 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:03.519335 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:15:03.593490 tst mo_mt_call_osmux.py: using LAC 23137 19:15:03.716772 tst mo_mt_call_osmux.py: using RAC 187 19:15:03.836497 tst mo_mt_call_osmux.py: using CellId 23137 19:15:03.956189 tst mo_mt_call_osmux.py: using BVCI 23138 19:15:04.067522 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:04.078818 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:04.089955 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:04.101641 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:04.113476 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:15:04.124882 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:15:04.245231 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:15:04.365152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:04.875411 run create_hlr_db(pid=5576): Launched 19:15:05.000052 bus /sierra_2: Setting Powered False 19:15:06.064126 run create_hlr_db(pid=5576): Terminated: ok {rc=0} 19:15:06.520624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5578): Launched 19:15:06.849463 run osmo-hlr_10.42.42.2(pid=5579): Launched 19:15:06.976566 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:07.541025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5581): Launched 19:15:07.869710 run osmo-stp_10.42.42.5(pid=5582): Launched 19:15:07.994417 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:08.587723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5584): Launched 19:15:08.918453 run osmo-msc_10.42.42.6(pid=5585): Launched 19:15:09.103504 run osmo-stp_10.42.42.5(pid=5582): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5582)] 19:15:09.243099 run osmo-stp_10.42.42.5(pid=5582): stdout: | (launched: 2022-12-09_19:15:07.809833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:09.382533 run osmo-stp_10.42.42.5(pid=5582): stderr: | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191508005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:09.520434 run osmo-stp_10.42.42.5(pid=5582): stdout: | (launched: 2022-12-09_19:15:07.809833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:09.651170 run osmo-stp_10.42.42.5(pid=5582): stderr: | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191508004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191508005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191508005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:09.808026 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5582): Process ended prematurely: osmo-stp_10.42.42.5(pid=5582) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5582)] [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:15:09.817927 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:15:09.846155 run osmo-hlr_10.42.42.2(pid=5579): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5579)] 19:15:09.895677 run osmo-hlr_10.42.42.2(pid=5579): stdout: | (launched: 2022-12-09_19:15:06.789484) 19:15:09.947028 run osmo-hlr_10.42.42.2(pid=5579): stderr: | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191506999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:10.018815 run osmo-msc_10.42.42.6(pid=5585): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5585)] 19:15:10.068475 run osmo-msc_10.42.42.6(pid=5585): stdout: | (launched: 2022-12-09_19:15:08.858106) 19:15:10.119829 run osmo-msc_10.42.42.6(pid=5585): stderr: | [0;m[38;5;43m20221209191509182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191509182 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa86f260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191509182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191509182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191509182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191509182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191509184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191509184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191509185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191509185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:10.171484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5578): Terminating (SIGTERM) 19:15:10.212823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5581): Terminating (SIGTERM) 19:15:10.254433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5584): Terminating (SIGTERM) 19:15:10.296280 --- ParallelTerminationStrategy: PID 5578 died... 19:15:10.316442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5578): Terminated: ok {rc=0} 19:15:10.362987 --- ParallelTerminationStrategy: PID 5581 died... 19:15:10.382582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5581): Terminated: ok {rc=0} 19:15:10.428812 --- ParallelTerminationStrategy: PID 5584 died... 19:15:10.448737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5584): Terminated: ok {rc=0} 19:15:10.537189 bus /sierra_3: Setting Powered False 19:15:11.635197 bus /sierra_3: Setting Powered False 19:15:12.751788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:15:14.005589 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:14.012857 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:15:14.047001 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:15:14.074331 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:15:14.128548 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:15:14.161681 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:15:14.188913 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:15:14.739306 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:15:14.792461 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:14.803981 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:15:14.874933 tst mo_mt_call.py: using LAC 23138 19:15:15.005650 tst mo_mt_call.py: using RAC 188 19:15:15.133367 tst mo_mt_call.py: using CellId 23138 19:15:15.262043 tst mo_mt_call.py: using BVCI 23139 19:15:15.382796 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:15.394411 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:15.405883 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:15.417542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:15.429296 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:15.440813 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:15:15.558244 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:15:15.672771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:16.173231 run create_hlr_db(pid=5590): Launched 19:15:16.324914 bus /sierra_2: Setting Powered False 19:15:17.385563 run create_hlr_db(pid=5590): Terminated: ok {rc=0} 19:15:17.836290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5592): Launched 19:15:18.164578 run osmo-hlr_10.42.42.2(pid=5593): Launched 19:15:18.289648 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:18.858341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5595): Launched 19:15:19.187250 run osmo-stp_10.42.42.5(pid=5596): Launched 19:15:19.314542 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:19.908821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5598): Launched 19:15:20.238488 run osmo-msc_10.42.42.6(pid=5599): Launched 19:15:20.423064 run osmo-stp_10.42.42.5(pid=5596): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5596)] 19:15:20.562065 run osmo-stp_10.42.42.5(pid=5596): stdout: | (launched: 2022-12-09_19:15:19.127417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:20.701679 run osmo-stp_10.42.42.5(pid=5596): stderr: | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191519320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:20.839833 run osmo-stp_10.42.42.5(pid=5596): stdout: | (launched: 2022-12-09_19:15:19.127417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:20.970955 run osmo-stp_10.42.42.5(pid=5596): stderr: | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191519320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191519320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191519321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:21.127595 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5596): Process ended prematurely: osmo-stp_10.42.42.5(pid=5596) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5596)] [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:15:21.137188 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:15:21.165412 run osmo-hlr_10.42.42.2(pid=5593): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5593)] 19:15:21.215205 run osmo-hlr_10.42.42.2(pid=5593): stdout: | (launched: 2022-12-09_19:15:18.104393) 19:15:21.266876 run osmo-hlr_10.42.42.2(pid=5593): stderr: | [0;m[1;31m20221209191518302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191518302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191518302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191518302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191518303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191518303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191518315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191518324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191518324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191518324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:21.338574 run osmo-msc_10.42.42.6(pid=5599): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5599)] 19:15:21.388539 run osmo-msc_10.42.42.6(pid=5599): stdout: | (launched: 2022-12-09_19:15:20.178182) 19:15:21.439726 run osmo-msc_10.42.42.6(pid=5599): stderr: | [0;m[38;5;43m20221209191520500 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191520500 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95f9331c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191520500 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191520500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191520500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191520501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191520502 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191520503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191520503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191520503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:21.491352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5592): Terminating (SIGTERM) 19:15:21.532908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5595): Terminating (SIGTERM) 19:15:21.574506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5598): Terminating (SIGTERM) 19:15:21.616324 --- ParallelTerminationStrategy: PID 5592 died... 19:15:21.636145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5592): Terminated: ok {rc=0} 19:15:21.682753 --- ParallelTerminationStrategy: PID 5595 died... 19:15:21.702120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5595): Terminated: ok {rc=0} 19:15:21.748506 --- ParallelTerminationStrategy: PID 5598 died... 19:15:21.767978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5598): Terminated: ok {rc=0} 19:15:21.856212 bus /sierra_3: Setting Powered False 19:15:22.955076 bus /sierra_3: Setting Powered False 19:15:24.073958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:15:25.225300 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.237537 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:15:25.309924 tst mo_mt_call_osmux.py: using LAC 23139 19:15:25.432308 tst mo_mt_call_osmux.py: using RAC 189 19:15:25.552127 tst mo_mt_call_osmux.py: using CellId 23139 19:15:25.673708 tst mo_mt_call_osmux.py: using BVCI 23140 19:15:25.786881 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.798257 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.809565 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.820637 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.831768 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:15:25.842871 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:15:25.961737 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:15:26.079333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:26.556126 run create_hlr_db(pid=5601): Launched 19:15:26.680707 bus /sierra_2: Setting Powered False 19:15:27.746083 run create_hlr_db(pid=5601): Terminated: ok {rc=0} 19:15:28.203190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5603): Launched 19:15:28.533621 run osmo-hlr_10.42.42.2(pid=5604): Launched 19:15:28.660374 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:29.231625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5606): Launched 19:15:29.540863 run osmo-stp_10.42.42.5(pid=5607): Launched 19:15:29.657146 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:30.212183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5609): Launched 19:15:30.519533 run osmo-msc_10.42.42.6(pid=5610): Launched 19:15:30.690468 run osmo-stp_10.42.42.5(pid=5607): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5607)] 19:15:30.836122 run osmo-stp_10.42.42.5(pid=5607): stdout: | (launched: 2022-12-09_19:15:29.484180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:31.023329 run osmo-stp_10.42.42.5(pid=5607): stderr: | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191529657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:31.166503 run osmo-stp_10.42.42.5(pid=5607): stdout: | (launched: 2022-12-09_19:15:29.484180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:31.302570 run osmo-stp_10.42.42.5(pid=5607): stderr: | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191529656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191529657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191529657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:31.466046 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5607): Process ended prematurely: osmo-stp_10.42.42.5(pid=5607) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5607)] [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:15:31.476684 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:15:31.508147 run osmo-hlr_10.42.42.2(pid=5604): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5604)] 19:15:31.562505 run osmo-hlr_10.42.42.2(pid=5604): stdout: | (launched: 2022-12-09_19:15:28.473546) 19:15:31.616856 run osmo-hlr_10.42.42.2(pid=5604): stderr: | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191528675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191528687 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191528696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191528696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191528696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:31.691581 run osmo-msc_10.42.42.6(pid=5610): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5610)] 19:15:31.746620 run osmo-msc_10.42.42.6(pid=5610): stdout: | (launched: 2022-12-09_19:15:30.462743) 19:15:31.802203 run osmo-msc_10.42.42.6(pid=5610): stderr: | [0;m[38;5;43m20221209191530738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191530738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1db0f7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191530738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191530738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191530739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191530739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191530742 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191530742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191530742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191530742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:31.856505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5603): Terminating (SIGTERM) 19:15:31.900813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5606): Terminating (SIGTERM) 19:15:31.945748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5609): Terminating (SIGTERM) 19:15:31.992550 --- ParallelTerminationStrategy: PID 5603 died... 19:15:32.013649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5603): Terminated: ok {rc=0} 19:15:32.064395 --- ParallelTerminationStrategy: PID 5606 died... 19:15:32.084892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5606): Terminated: ok {rc=0} 19:15:32.134096 --- ParallelTerminationStrategy: PID 5609 died... 19:15:32.155500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5609): Terminated: ok {rc=0} 19:15:32.245894 bus /sierra_3: Setting Powered False 19:15:33.343014 bus /sierra_3: Setting Powered False 19:15:34.458372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:15:35.707495 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:35.713696 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:15:35.748482 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:15:35.775623 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:15:35.829331 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:15:35.862704 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:15:35.889690 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:15:36.439833 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:15:36.492717 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:36.504069 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:15:36.574807 tst mo_mt_call.py: using LAC 23140 19:15:36.704759 tst mo_mt_call.py: using RAC 190 19:15:36.827158 tst mo_mt_call.py: using CellId 23140 19:15:36.948723 tst mo_mt_call.py: using BVCI 23141 19:15:37.069217 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:37.080471 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:37.091602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:37.103206 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:37.114661 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:37.126032 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:15:37.243832 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:15:37.359520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:37.836449 run create_hlr_db(pid=5615): Launched 19:15:37.962005 bus /sierra_2: Setting Powered False 19:15:39.022503 run create_hlr_db(pid=5615): Terminated: ok {rc=0} 19:15:39.451032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5617): Launched 19:15:39.759455 run osmo-hlr_10.42.42.2(pid=5618): Launched 19:15:39.877435 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:40.412428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5620): Launched 19:15:40.718872 run osmo-stp_10.42.42.5(pid=5621): Launched 19:15:40.835107 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:41.388413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5623): Launched 19:15:41.695516 run osmo-msc_10.42.42.6(pid=5624): Launched 19:15:41.866331 run osmo-stp_10.42.42.5(pid=5621): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5621)] 19:15:41.995367 run osmo-stp_10.42.42.5(pid=5621): stdout: | (launched: 2022-12-09_19:15:40.662448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:42.123973 run osmo-stp_10.42.42.5(pid=5621): stderr: | [0;m[38;5;43m20221209191540834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191540834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191540835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191540835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:42.251021 run osmo-stp_10.42.42.5(pid=5621): stdout: | (launched: 2022-12-09_19:15:40.662448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:42.372720 run osmo-stp_10.42.42.5(pid=5621): stderr: | [0;m[38;5;43m20221209191540834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191540834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191540835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191540835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191540836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:42.519206 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5621): Process ended prematurely: osmo-stp_10.42.42.5(pid=5621) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5621)] [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:15:42.528157 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:15:42.554368 run osmo-hlr_10.42.42.2(pid=5618): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5618)] 19:15:42.601453 run osmo-hlr_10.42.42.2(pid=5618): stdout: | (launched: 2022-12-09_19:15:39.702139) 19:15:42.650000 run osmo-hlr_10.42.42.2(pid=5618): stderr: | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191539880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191539892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191539901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191539901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191539901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:42.717837 run osmo-msc_10.42.42.6(pid=5624): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5624)] 19:15:42.764639 run osmo-msc_10.42.42.6(pid=5624): stdout: | (launched: 2022-12-09_19:15:41.638904) 19:15:42.813121 run osmo-msc_10.42.42.6(pid=5624): stderr: | [0;m[38;5;43m20221209191541913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191541913 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f496ae97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191541913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191541913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191541913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191541914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191541918 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191541918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191541919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191541919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:42.861861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5617): Terminating (SIGTERM) 19:15:42.900667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5620): Terminating (SIGTERM) 19:15:42.939309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5623): Terminating (SIGTERM) 19:15:42.978348 --- ParallelTerminationStrategy: PID 5617 died... 19:15:42.997208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5617): Terminated: ok {rc=0} 19:15:43.040722 --- ParallelTerminationStrategy: PID 5620 died... 19:15:43.059258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5620): Terminated: ok {rc=0} 19:15:43.102425 --- ParallelTerminationStrategy: PID 5623 died... 19:15:43.120781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5623): Terminated: ok {rc=0} 19:15:43.204996 bus /sierra_3: Setting Powered False 19:15:44.300342 bus /sierra_3: Setting Powered False 19:15:45.415473 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:15:46.561077 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:46.573582 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:15:46.643488 tst mo_mt_call_osmux.py: using LAC 23141 19:15:46.777995 tst mo_mt_call_osmux.py: using RAC 191 19:15:46.910842 tst mo_mt_call_osmux.py: using CellId 23141 19:15:47.045012 tst mo_mt_call_osmux.py: using BVCI 23142 19:15:47.167968 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:47.180336 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:47.192162 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:47.203568 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:47.215077 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:15:47.226565 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:15:47.342837 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:15:47.459076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:47.937818 run create_hlr_db(pid=5626): Launched 19:15:48.067803 bus /sierra_2: Setting Powered False 19:15:49.132221 run create_hlr_db(pid=5626): Terminated: ok {rc=0} 19:15:49.592400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Launched 19:15:49.923251 run osmo-hlr_10.42.42.2(pid=5629): Launched 19:15:50.049081 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:50.618918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Launched 19:15:50.949127 run osmo-stp_10.42.42.5(pid=5632): Launched 19:15:51.076353 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:51.678603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Launched 19:15:52.009677 run osmo-msc_10.42.42.6(pid=5635): Launched 19:15:52.194580 run osmo-stp_10.42.42.5(pid=5632): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] 19:15:52.333136 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-09_19:15:50.888786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:52.472219 run osmo-stp_10.42.42.5(pid=5632): stderr: | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191551083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:52.609743 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-09_19:15:50.888786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:52.740698 run osmo-stp_10.42.42.5(pid=5632): stderr: | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191551082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191551083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191551083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:52.898714 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:15:52.908437 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:15:52.936685 run osmo-hlr_10.42.42.2(pid=5629): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5629)] 19:15:52.986332 run osmo-hlr_10.42.42.2(pid=5629): stdout: | (launched: 2022-12-09_19:15:49.863064) 19:15:53.037633 run osmo-hlr_10.42.42.2(pid=5629): stderr: | [0;m[1;31m20221209191550064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191550064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191550064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191550064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191550065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191550065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191550077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191550085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191550085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191550086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:53.109221 run osmo-msc_10.42.42.6(pid=5635): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5635)] 19:15:53.158927 run osmo-msc_10.42.42.6(pid=5635): stdout: | (launched: 2022-12-09_19:15:51.949462) 19:15:53.210137 run osmo-msc_10.42.42.6(pid=5635): stderr: | [0;m[38;5;43m20221209191552272 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191552272 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12c2b6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191552272 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191552272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191552272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191552272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191552274 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191552275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191552275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191552275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:53.261878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminating (SIGTERM) 19:15:53.303207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminating (SIGTERM) 19:15:53.344666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Terminating (SIGTERM) 19:15:53.386374 --- ParallelTerminationStrategy: PID 5628 died... 19:15:53.406058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminated: ok {rc=0} 19:15:53.452173 --- ParallelTerminationStrategy: PID 5631 died... 19:15:53.471492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminated: ok {rc=0} 19:15:53.517391 --- ParallelTerminationStrategy: PID 5634 died... 19:15:53.536738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Terminated: ok {rc=0} 19:15:53.624577 bus /sierra_3: Setting Powered False 19:15:54.724062 bus /sierra_3: Setting Powered False 19:15:55.841921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:15:57.087403 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:57.093859 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:15:57.126778 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:15:57.153039 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:15:57.204286 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:15:57.236192 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:15:57.262115 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:15:57.814948 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:15:57.863997 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:57.875210 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:15:57.925854 tst mo_mt_call.py: using LAC 23142 19:15:58.051409 tst mo_mt_call.py: using RAC 192 19:15:58.171504 tst mo_mt_call.py: using CellId 23142 19:15:58.291412 tst mo_mt_call.py: using BVCI 23143 19:15:58.402270 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:58.413426 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:58.424356 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:58.435437 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:58.446534 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:15:58.457500 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:15:58.576287 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:15:58.692755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:59.205437 run create_hlr_db(pid=5640): Launched 19:15:59.331426 bus /sierra_2: Setting Powered False 19:16:00.396254 run create_hlr_db(pid=5640): Terminated: ok {rc=0} 19:16:00.857858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5642): Launched 19:16:01.254561 run osmo-hlr_10.42.42.2(pid=5643): Launched 19:16:01.487252 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:02.188540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5645): Launched 19:16:02.531600 run osmo-stp_10.42.42.5(pid=5646): Launched 19:16:02.658846 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:03.258327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5648): Launched 19:16:03.588677 run osmo-msc_10.42.42.6(pid=5649): Launched 19:16:03.771974 run osmo-stp_10.42.42.5(pid=5646): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5646)] 19:16:03.911424 run osmo-stp_10.42.42.5(pid=5646): stdout: | (launched: 2022-12-09_19:16:02.471306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:04.051479 run osmo-stp_10.42.42.5(pid=5646): stderr: | [0;m[38;5;43m20221209191602665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191602665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191602666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191602666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:04.189520 run osmo-stp_10.42.42.5(pid=5646): stdout: | (launched: 2022-12-09_19:16:02.471306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:04.321260 run osmo-stp_10.42.42.5(pid=5646): stderr: | [0;m[38;5;43m20221209191602665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191602665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191602666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191602666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191602667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:04.478617 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5646): Process ended prematurely: osmo-stp_10.42.42.5(pid=5646) [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5646)] [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:16:04.488302 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:16:04.516463 run osmo-hlr_10.42.42.2(pid=5643): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5643)] 19:16:04.567028 run osmo-hlr_10.42.42.2(pid=5643): stdout: | (launched: 2022-12-09_19:16:01.187740) 19:16:04.619113 run osmo-hlr_10.42.42.2(pid=5643): stderr: | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191601568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191601581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191601598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191601598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191601598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:04.691337 run osmo-msc_10.42.42.6(pid=5649): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5649)] 19:16:04.741712 run osmo-msc_10.42.42.6(pid=5649): stdout: | (launched: 2022-12-09_19:16:03.527954) 19:16:04.794252 run osmo-msc_10.42.42.6(pid=5649): stderr: | [0;m[38;5;43m20221209191603852 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191603853 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61f46d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191603853 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191603853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191603853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191603853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191603855 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191603855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191603855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191603855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:04.846808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5642): Terminating (SIGTERM) 19:16:04.888840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5645): Terminating (SIGTERM) 19:16:04.930949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5648): Terminating (SIGTERM) 19:16:04.973195 --- ParallelTerminationStrategy: PID 5642 died... 19:16:04.993250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5642): Terminated: ok {rc=0} 19:16:05.039944 --- ParallelTerminationStrategy: PID 5645 died... 19:16:05.059615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5645): Terminated: ok {rc=0} 19:16:05.106161 --- ParallelTerminationStrategy: PID 5648 died... 19:16:05.125738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5648): Terminated: ok {rc=0} 19:16:05.214514 bus /sierra_3: Setting Powered False 19:16:06.313727 bus /sierra_3: Setting Powered False 19:16:07.429511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:16:08.578226 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:08.590740 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:16:08.644564 tst mo_mt_call_osmux.py: using LAC 23143 19:16:08.771924 tst mo_mt_call_osmux.py: using RAC 193 19:16:08.899868 tst mo_mt_call_osmux.py: using CellId 23143 19:16:09.027568 tst mo_mt_call_osmux.py: using BVCI 23144 19:16:09.146983 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:09.158741 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:09.170340 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:09.182139 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:09.194100 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:16:09.206150 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:16:09.325560 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:16:09.447167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:09.960614 run create_hlr_db(pid=5651): Launched 19:16:10.086409 bus /sierra_2: Setting Powered False 19:16:11.151893 run create_hlr_db(pid=5651): Terminated: ok {rc=0} 19:16:11.594311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Launched 19:16:11.904357 run osmo-hlr_10.42.42.2(pid=5654): Launched 19:16:12.021969 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:12.567790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Launched 19:16:12.875826 run osmo-stp_10.42.42.5(pid=5657): Launched 19:16:12.997101 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:13.556100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Launched 19:16:13.865965 run osmo-msc_10.42.42.6(pid=5660): Launched 19:16:14.037190 run osmo-stp_10.42.42.5(pid=5657): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] 19:16:14.166806 run osmo-stp_10.42.42.5(pid=5657): stdout: | (launched: 2022-12-09_19:16:12.819236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:14.296336 run osmo-stp_10.42.42.5(pid=5657): stderr: | [0;m[38;5;43m20221209191612992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191612992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191612993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191612993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191612993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191612994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191612994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:14.424312 run osmo-stp_10.42.42.5(pid=5657): stdout: | (launched: 2022-12-09_19:16:12.819236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:14.546635 run osmo-stp_10.42.42.5(pid=5657): stderr: | [0;m[38;5;43m20221209191612992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191612992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191612993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191612993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191612993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191612994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191612994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:14.693223 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5657): Process ended prematurely: osmo-stp_10.42.42.5(pid=5657) [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:16:14.702401 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:16:14.728750 run osmo-hlr_10.42.42.2(pid=5654): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5654)] 19:16:14.776005 run osmo-hlr_10.42.42.2(pid=5654): stdout: | (launched: 2022-12-09_19:16:11.847269) 19:16:14.825320 run osmo-hlr_10.42.42.2(pid=5654): stderr: | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191612025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191612037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191612046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191612046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191612046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:14.893731 run osmo-msc_10.42.42.6(pid=5660): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5660)] 19:16:14.940941 run osmo-msc_10.42.42.6(pid=5660): stdout: | (launched: 2022-12-09_19:16:13.809113) 19:16:14.989690 run osmo-msc_10.42.42.6(pid=5660): stderr: | [0;m[38;5;43m20221209191614083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191614083 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f202b833c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191614083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191614083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191614083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191614083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191614085 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191614085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191614086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191614086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:15.038787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Terminating (SIGTERM) 19:16:15.078024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Terminating (SIGTERM) 19:16:15.117527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Terminating (SIGTERM) 19:16:15.157070 --- ParallelTerminationStrategy: PID 5653 died... 19:16:15.175804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Terminated: ok {rc=0} 19:16:15.219613 --- ParallelTerminationStrategy: PID 5656 died... 19:16:15.238093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Terminated: ok {rc=0} 19:16:15.281626 --- ParallelTerminationStrategy: PID 5659 died... 19:16:15.300224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Terminated: ok {rc=0} 19:16:15.385269 bus /sierra_3: Setting Powered False 19:16:16.483580 bus /sierra_3: Setting Powered False 19:16:17.614272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:trx-umtrx --------------------------------------------------------------------- 19:16:18.867616 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:18.872337 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:16:18.906193 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:16:18.933713 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:16:19.020615 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:16:19.055053 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:16:19.082647 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:16:19.660240 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 19:16:19.665584 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:19.676190 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:16:19.729148 tst emergency_mo_mt_call.py: using LAC 23144 19:16:19.848023 tst emergency_mo_mt_call.py: using RAC 194 19:16:19.964304 tst emergency_mo_mt_call.py: using CellId 23144 19:16:20.080528 tst emergency_mo_mt_call.py: using BVCI 23145 19:16:20.189358 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:20.199901 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:20.210266 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:20.220635 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:20.231040 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:20.241391 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:20.359177 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:20.481211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:20.986672 run create_hlr_db(pid=5665): Launched 19:16:21.112556 bus /sierra_2: Setting Powered False 19:16:22.176832 run create_hlr_db(pid=5665): Terminated: ok {rc=0} 19:16:22.630434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5667): Launched 19:16:22.957165 run osmo-hlr_10.42.42.2(pid=5668): Launched 19:16:23.074170 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:23.599386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5670): Launched 19:16:23.903649 run osmo-stp_10.42.42.5(pid=5671): Launched 19:16:24.028846 tst emergency_mo_mt_call.py: using MSISDN 7335 19:16:24.182680 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:24.729657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5673): Launched 19:16:25.033514 run osmo-msc_10.42.42.6(pid=5674): Launched 19:16:25.201904 run osmo-stp_10.42.42.5(pid=5671): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5671)] 19:16:25.329957 run osmo-stp_10.42.42.5(pid=5671): stdout: | (launched: 2022-12-09_19:16:23.847544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:25.457360 run osmo-stp_10.42.42.5(pid=5671): stderr: | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191624021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:25.583341 run osmo-stp_10.42.42.5(pid=5671): stdout: | (launched: 2022-12-09_19:16:23.847544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:25.703997 run osmo-stp_10.42.42.5(pid=5671): stderr: | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191624020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191624021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191624022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:25.849516 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5671): Process ended prematurely: osmo-stp_10.42.42.5(pid=5671) [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5671)] [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 19:16:25.858106 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 19:16:25.884093 run osmo-hlr_10.42.42.2(pid=5668): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5668)] 19:16:25.931594 run osmo-hlr_10.42.42.2(pid=5668): stdout: | (launched: 2022-12-09_19:16:22.897703) 19:16:25.980582 run osmo-hlr_10.42.42.2(pid=5668): stderr: | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191623080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191623092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191623103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191623103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191623103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:26.048776 run osmo-msc_10.42.42.6(pid=5674): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5674)] 19:16:26.095866 run osmo-msc_10.42.42.6(pid=5674): stdout: | (launched: 2022-12-09_19:16:24.977330) 19:16:26.144437 run osmo-msc_10.42.42.6(pid=5674): stderr: | [0;m[38;5;43m20221209191625253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191625253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d01142c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191625253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191625253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191625254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191625254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191625256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191625256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191625256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191625256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:26.193478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5667): Terminating (SIGTERM) 19:16:26.232755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5670): Terminating (SIGTERM) 19:16:26.272119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5673): Terminating (SIGTERM) 19:16:26.312047 --- ParallelTerminationStrategy: PID 5667 died... 19:16:26.331162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5667): Terminated: ok {rc=0} 19:16:26.375112 --- ParallelTerminationStrategy: PID 5670 died... 19:16:26.393804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5670): Terminated: ok {rc=0} 19:16:26.437477 --- ParallelTerminationStrategy: PID 5673 died... 19:16:26.456122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5673): Terminated: ok {rc=0} 19:16:26.541524 bus /sierra_3: Setting Powered False 19:16:27.641769 bus /sierra_3: Setting Powered False 19:16:28.757096 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 19:16:29.846984 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:29.858971 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:16:29.910069 tst emergency_preemptive_call.py: using LAC 23145 19:16:30.037160 tst emergency_preemptive_call.py: using RAC 195 19:16:30.165404 tst emergency_preemptive_call.py: using CellId 23145 19:16:30.292025 tst emergency_preemptive_call.py: using BVCI 23146 19:16:30.411554 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:30.423088 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:30.434297 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:30.445724 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:30.457071 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:16:30.468135 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:30.587206 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:30.706603 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:30.825178 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:30.940942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:31.427672 run create_hlr_db(pid=5676): Launched 19:16:31.578519 bus /sierra_2: Setting Powered False 19:16:32.639223 run create_hlr_db(pid=5676): Terminated: ok {rc=0} 19:16:33.062830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Launched 19:16:33.366448 run osmo-hlr_10.42.42.2(pid=5679): Launched 19:16:33.481775 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:34.005064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Launched 19:16:34.307988 run osmo-stp_10.42.42.5(pid=5682): Launched 19:16:34.445356 tst emergency_preemptive_call.py: using MSISDN 7336 19:16:34.599909 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:35.143833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Launched 19:16:35.446624 run osmo-msc_10.42.42.6(pid=5685): Launched 19:16:35.616911 run osmo-stp_10.42.42.5(pid=5682): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] 19:16:35.744318 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-09_19:16:34.251877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:35.872643 run osmo-stp_10.42.42.5(pid=5682): stderr: | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191634426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:35.998341 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-09_19:16:34.251877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:36.119184 run osmo-stp_10.42.42.5(pid=5682): stderr: | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191634425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191634426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191634426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:36.263363 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 19:16:36.271905 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 19:16:36.298087 run osmo-hlr_10.42.42.2(pid=5679): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5679)] 19:16:36.345705 run osmo-hlr_10.42.42.2(pid=5679): stdout: | (launched: 2022-12-09_19:16:33.310359) 19:16:36.394840 run osmo-hlr_10.42.42.2(pid=5679): stderr: | [0;m[1;31m20221209191633486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191633486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191633487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191633487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191633487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191633487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191633497 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191633506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191633506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191633507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:36.463179 run osmo-msc_10.42.42.6(pid=5685): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5685)] 19:16:36.510307 run osmo-msc_10.42.42.6(pid=5685): stdout: | (launched: 2022-12-09_19:16:35.390404) 19:16:36.558905 run osmo-msc_10.42.42.6(pid=5685): stderr: | [0;m[38;5;43m20221209191635664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209191635664 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb32f235c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209191635664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209191635664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209191635664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209191635665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209191635667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209191635668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209191635668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209191635668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:36.607961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminating (SIGTERM) 19:16:36.647288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminating (SIGTERM) 19:16:36.686732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Terminating (SIGTERM) 19:16:36.726598 --- ParallelTerminationStrategy: PID 5678 died... 19:16:36.745641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminated: ok {rc=0} 19:16:36.789941 --- ParallelTerminationStrategy: PID 5681 died... 19:16:36.808405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminated: ok {rc=0} 19:16:36.852299 --- ParallelTerminationStrategy: PID 5684 died... 19:16:36.871264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Terminated: ok {rc=0} 19:16:36.954016 bus /sierra_9: Setting Powered False 19:16:38.051918 bus /sierra_9: Setting Powered False 19:16:39.168403 bus /sierra_8: Setting Powered False 19:16:40.266272 bus /sierra_8: Setting Powered False 19:16:41.382604 bus /sierra_3: Setting Powered False 19:16:42.483477 bus /sierra_3: Setting Powered False 19:16:43.598161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx --------------------------------------------------------------------- 19:16:44.880291 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:44.885205 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:16:44.919304 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 19:16:44.958567 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:16:45.046979 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:16:45.080914 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 19:16:45.119269 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:16:45.705955 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 19:16:45.757421 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:45.768020 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:16:45.815710 tst cs_paging_gprs_active.py: using LAC 23146 19:16:45.955522 tst cs_paging_gprs_active.py: using RAC 196 19:16:46.090543 tst cs_paging_gprs_active.py: using CellId 23146 19:16:46.225827 tst cs_paging_gprs_active.py: using BVCI 23147 19:16:46.353630 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.365595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.377474 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.390615 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.402325 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.414272 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.427470 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.440096 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:46.451970 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:46.600205 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:46.725147 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:16:46.938264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:47.257120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5690): Launched 19:16:47.525406 run iperf3-srv_10.42.42.10(pid=5691): Launched 19:16:47.640324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:16:47.847322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:48.157186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5692): Launched 19:16:48.444631 run iperf3-srv_10.42.42.10(pid=5693): Launched 19:16:48.567765 tst cs_paging_gprs_active.py:38: start network... 19:16:48.791125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:49.303337 run create_hlr_db(pid=5694): Launched 19:16:49.429874 bus /sierra_2: Setting Powered False 19:16:50.491077 run create_hlr_db(pid=5694): Terminated: ok {rc=0} 19:16:50.951410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5696): Launched 19:16:51.282793 run osmo-hlr_10.42.42.2(pid=5697): Launched 19:16:51.410773 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:51.981218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5699): Launched 19:16:52.312324 run osmo-stp_10.42.42.5(pid=5700): Launched 19:16:52.440087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:53.009584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5702): Launched 19:16:53.136798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:53.415908 run patchelf(pid=5703): Launched 19:16:53.600637 run osmo-stp_10.42.42.5(pid=5700): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5700)] 19:16:53.740274 run osmo-stp_10.42.42.5(pid=5700): stdout: | (launched: 2022-12-09_19:16:52.251514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:53.882176 run osmo-stp_10.42.42.5(pid=5700): stderr: | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191652448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:54.024252 run osmo-stp_10.42.42.5(pid=5700): stdout: | (launched: 2022-12-09_19:16:52.251514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:54.159663 run osmo-stp_10.42.42.5(pid=5700): stderr: | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191652447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191652448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191652448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:54.320177 run patchelf(pid=5703): Terminating (SIGINT) 19:16:54.504749 run patchelf(pid=5703): Terminated: ok {rc=0} 19:16:54.638265 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5700): Process ended prematurely: osmo-stp_10.42.42.5(pid=5700) [trial-2363↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5700)] [trial-2363↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 19:16:54.648476 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:16:54.677462 run osmo-hlr_10.42.42.2(pid=5697): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5697)] 19:16:54.727486 run osmo-hlr_10.42.42.2(pid=5697): stdout: | (launched: 2022-12-09_19:16:51.222426) 19:16:54.778996 run osmo-hlr_10.42.42.2(pid=5697): stderr: | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191651422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191651435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191651445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191651445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191651445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:54.831247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5690): Terminating (SIGTERM) 19:16:54.873216 run iperf3-srv_10.42.42.10(pid=5691): Terminating (SIGTERM) 19:16:54.914857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5692): Terminating (SIGTERM) 19:16:54.957137 run iperf3-srv_10.42.42.10(pid=5693): Terminating (SIGTERM) 19:16:54.998664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5696): Terminating (SIGTERM) 19:16:55.040309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5699): Terminating (SIGTERM) 19:16:55.082061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5702): Terminating (SIGTERM) 19:16:55.123958 --- ParallelTerminationStrategy: PID 5690 died... 19:16:55.144005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5690): Terminated: ok {rc=0} 19:16:55.190447 --- ParallelTerminationStrategy: PID 5691 died... 19:16:55.209970 run iperf3-srv_10.42.42.10(pid=5691): Terminated {rc=256} 19:16:55.256258 --- ParallelTerminationStrategy: PID 5692 died... 19:16:55.275829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5692): Terminated: ok {rc=0} 19:16:55.322292 --- ParallelTerminationStrategy: PID 5693 died... 19:16:55.341764 run iperf3-srv_10.42.42.10(pid=5693): Terminated {rc=256} 19:16:55.387945 --- ParallelTerminationStrategy: PID 5696 died... 19:16:55.407343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5696): Terminated: ok {rc=0} 19:16:55.453771 --- ParallelTerminationStrategy: PID 5699 died... 19:16:55.473378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5699): Terminated: ok {rc=0} 19:16:55.519753 --- ParallelTerminationStrategy: PID 5702 died... 19:16:55.539343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5702): Terminated: ok {rc=0} 19:16:55.626820 bus /gobi_0: Setting Powered False 19:16:56.725194 bus /gobi_0: Setting Powered False 19:16:57.842382 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx iperf3.py ---------------------------------------------- 19:16:58.993052 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.004599 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:16:59.057929 tst iperf3.py: using LAC 23147 19:16:59.186807 tst iperf3.py: using RAC 197 19:16:59.315550 tst iperf3.py: using CellId 23147 19:16:59.447241 tst iperf3.py: using BVCI 23148 19:16:59.568005 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.579087 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.589966 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.601090 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.612002 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.622936 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.634133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.645033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:16:59.656241 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:16:59.773973 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:16:59.982873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:00.294509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5704): Launched 19:17:00.565259 run iperf3-srv_10.42.42.10(pid=5705): Launched 19:17:00.681383 tst iperf3.py:8: start network... 19:17:00.890728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:01.391295 run create_hlr_db(pid=5709): Launched 19:17:01.551836 bus /gobi_6: Setting Powered False 19:17:02.611239 run create_hlr_db(pid=5709): Terminated: ok {rc=0} 19:17:03.082514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Launched 19:17:03.414506 run osmo-hlr_10.42.42.2(pid=5712): Launched 19:17:03.541884 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:04.112456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Launched 19:17:04.442129 run osmo-stp_10.42.42.5(pid=5715): Launched 19:17:04.569786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:05.140574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5717): Launched 19:17:05.266322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:05.545043 run patchelf(pid=5718): Launched 19:17:05.728672 run osmo-stp_10.42.42.5(pid=5715): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] 19:17:05.868372 run osmo-stp_10.42.42.5(pid=5715): stdout: | (launched: 2022-12-09_19:17:04.381825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:06.009137 run osmo-stp_10.42.42.5(pid=5715): stderr: | [0;m[38;5;43m20221209191704575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191704576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191704576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191704576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:06.150112 run osmo-stp_10.42.42.5(pid=5715): stdout: | (launched: 2022-12-09_19:17:04.381825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:06.285287 run osmo-stp_10.42.42.5(pid=5715): stderr: | [0;m[38;5;43m20221209191704575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191704576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191704576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191704576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191704577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:06.445612 run patchelf(pid=5718): Terminating (SIGINT) 19:17:06.629606 run patchelf(pid=5718): Terminated: ok {rc=0} 19:17:06.762103 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5715): Process ended prematurely: osmo-stp_10.42.42.5(pid=5715) [trial-2363↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] [trial-2363↪gprs:trx-umtrx↪iperf3.py:8] 19:17:06.772354 tst iperf3.py:8: Test FAILED (7.8 sec) 19:17:06.801326 run osmo-hlr_10.42.42.2(pid=5712): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5712)] 19:17:06.851542 run osmo-hlr_10.42.42.2(pid=5712): stdout: | (launched: 2022-12-09_19:17:03.354314) 19:17:06.902601 run osmo-hlr_10.42.42.2(pid=5712): stderr: | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191703554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191703568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191703578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191703578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191703578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:06.954899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5704): Terminating (SIGTERM) 19:17:06.996399 run iperf3-srv_10.42.42.10(pid=5705): Terminating (SIGTERM) 19:17:07.037850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Terminating (SIGTERM) 19:17:07.079441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Terminating (SIGTERM) 19:17:07.120918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5717): Terminating (SIGTERM) 19:17:07.163211 --- ParallelTerminationStrategy: PID 5704 died... 19:17:07.183020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5704): Terminated: ok {rc=0} 19:17:07.228931 --- ParallelTerminationStrategy: PID 5705 died... 19:17:07.248169 run iperf3-srv_10.42.42.10(pid=5705): Terminated {rc=256} 19:17:07.293875 --- ParallelTerminationStrategy: PID 5711 died... 19:17:07.313199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Terminated: ok {rc=0} 19:17:07.358768 --- ParallelTerminationStrategy: PID 5714 died... 19:17:07.378040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Terminated: ok {rc=0} 19:17:07.423647 --- ParallelTerminationStrategy: PID 5717 died... 19:17:07.442927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5717): Terminated: ok {rc=0} 19:17:07.530073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 19:17:08.679866 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:08.691663 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:17:08.741397 tst iperf3m4.py: using LAC 23148 19:17:08.871782 tst iperf3m4.py: using RAC 198 19:17:09.004894 tst iperf3m4.py: using CellId 23148 19:17:09.132125 tst iperf3m4.py: using BVCI 23149 19:17:09.253310 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.264340 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.275226 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.286377 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.297453 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.308372 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.319644 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.330736 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:09.342074 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:09.462815 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:09.587324 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:09.707576 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:09.823647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:17:10.032104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:10.342829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5719): Launched 19:17:10.613660 run iperf3-srv_10.42.42.10(pid=5720): Launched 19:17:10.728574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:17:10.936111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:11.245625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5721): Launched 19:17:11.513458 run iperf3-srv_10.42.42.10(pid=5722): Launched 19:17:11.628434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:17:11.835830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:12.146652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5723): Launched 19:17:12.414465 run iperf3-srv_10.42.42.10(pid=5724): Launched 19:17:12.529530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:17:12.736624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:13.046634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5725): Launched 19:17:13.314917 run iperf3-srv_10.42.42.10(pid=5726): Launched 19:17:13.429901 tst iperf3m4.py:8: start network... 19:17:13.636433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:14.114793 run create_hlr_db(pid=5727): Launched 19:17:14.241843 bus /gobi_6: Setting Powered False 19:17:15.303487 run create_hlr_db(pid=5727): Terminated: ok {rc=0} 19:17:15.752385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Launched 19:17:16.111220 run osmo-hlr_10.42.42.2(pid=5730): Launched 19:17:16.386920 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:17.084380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Launched 19:17:17.429885 run osmo-stp_10.42.42.5(pid=5733): Launched 19:17:17.558687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:18.089761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5735): Launched 19:17:18.206792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:18.466026 run patchelf(pid=5736): Launched 19:17:18.635669 run osmo-stp_10.42.42.5(pid=5733): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] 19:17:18.764710 run osmo-stp_10.42.42.5(pid=5733): stdout: | (launched: 2022-12-09_19:17:17.369387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:18.895987 run osmo-stp_10.42.42.5(pid=5733): stderr: | [0;m[38;5;43m20221209191717560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191717561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191717561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191717561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:19.026710 run osmo-stp_10.42.42.5(pid=5733): stdout: | (launched: 2022-12-09_19:17:17.369387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:19.151838 run osmo-stp_10.42.42.5(pid=5733): stderr: | [0;m[38;5;43m20221209191717560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191717561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191717561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191717561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191717562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:19.300209 run patchelf(pid=5736): Terminating (SIGINT) 19:17:19.471652 run patchelf(pid=5736): Terminated: ok {rc=0} 19:17:19.596569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5733): Process ended prematurely: osmo-stp_10.42.42.5(pid=5733) [trial-2363↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] [trial-2363↪gprs:trx-umtrx↪iperf3m4.py:8] 19:17:19.606198 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:17:19.633152 run osmo-hlr_10.42.42.2(pid=5730): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5730)] 19:17:19.679714 run osmo-hlr_10.42.42.2(pid=5730): stdout: | (launched: 2022-12-09_19:17:16.049794) 19:17:19.728196 run osmo-hlr_10.42.42.2(pid=5730): stderr: | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191716273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191716295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191716312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191716312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191716314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:19.776770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5719): Terminating (SIGTERM) 19:17:19.815577 run iperf3-srv_10.42.42.10(pid=5720): Terminating (SIGTERM) 19:17:19.854332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5721): Terminating (SIGTERM) 19:17:19.893123 run iperf3-srv_10.42.42.10(pid=5722): Terminating (SIGTERM) 19:17:19.931734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5723): Terminating (SIGTERM) 19:17:19.970379 run iperf3-srv_10.42.42.10(pid=5724): Terminating (SIGTERM) 19:17:20.008833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5725): Terminating (SIGTERM) 19:17:20.047492 run iperf3-srv_10.42.42.10(pid=5726): Terminating (SIGTERM) 19:17:20.086124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Terminating (SIGTERM) 19:17:20.124915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Terminating (SIGTERM) 19:17:20.163513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5735): Terminating (SIGTERM) 19:17:20.202896 --- ParallelTerminationStrategy: PID 5719 died... 19:17:20.221659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5719): Terminated: ok {rc=0} 19:17:20.264693 --- ParallelTerminationStrategy: PID 5720 died... 19:17:20.282818 run iperf3-srv_10.42.42.10(pid=5720): Terminated {rc=256} 19:17:20.325895 --- ParallelTerminationStrategy: PID 5721 died... 19:17:20.344106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5721): Terminated: ok {rc=0} 19:17:20.387025 --- ParallelTerminationStrategy: PID 5722 died... 19:17:20.405222 run iperf3-srv_10.42.42.10(pid=5722): Terminated {rc=256} 19:17:20.448157 --- ParallelTerminationStrategy: PID 5723 died... 19:17:20.466324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5723): Terminated: ok {rc=0} 19:17:20.509336 --- ParallelTerminationStrategy: PID 5724 died... 19:17:20.527566 run iperf3-srv_10.42.42.10(pid=5724): Terminated {rc=256} 19:17:20.571029 --- ParallelTerminationStrategy: PID 5725 died... 19:17:20.589302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5725): Terminated: ok {rc=0} 19:17:20.632128 --- ParallelTerminationStrategy: PID 5726 died... 19:17:20.650345 run iperf3-srv_10.42.42.10(pid=5726): Terminated {rc=256} 19:17:20.693162 --- ParallelTerminationStrategy: PID 5729 died... 19:17:20.711396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Terminated: ok {rc=0} 19:17:20.754295 --- ParallelTerminationStrategy: PID 5732 died... 19:17:20.773001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Terminated: ok {rc=0} 19:17:20.815967 --- ParallelTerminationStrategy: PID 5735 died... 19:17:20.834332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5735): Terminated: ok {rc=0} 19:17:20.919088 bus /gobi_4: Setting Powered False 19:17:22.018790 bus /gobi_4: Setting Powered False 19:17:23.132636 bus /gobi_1: Setting Powered False 19:17:24.231761 bus /gobi_1: Setting Powered False 19:17:25.346384 bus /gobi_0: Setting Powered False 19:17:26.443670 bus /gobi_0: Setting Powered False 19:17:27.559214 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx ping.py ---------------------------------------------- 19:17:28.661143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:28.672160 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:17:28.720839 tst ping.py: using LAC 23149 19:17:28.841359 tst ping.py: using RAC 199 19:17:28.959726 tst ping.py: using CellId 23149 19:17:29.089399 tst ping.py: using BVCI 23150 19:17:29.199734 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.210442 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.221045 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.231293 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.241763 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.252103 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.262444 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:29.272936 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:29.386567 tst ping.py:19: start network... 19:17:29.589899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:30.059110 run create_hlr_db(pid=5737): Launched 19:17:30.182264 bus /gobi_6: Setting Powered False 19:17:31.248409 run create_hlr_db(pid=5737): Terminated: ok {rc=0} 19:17:31.739773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Launched 19:17:32.122742 run osmo-hlr_10.42.42.2(pid=5740): Launched 19:17:32.307648 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:32.829227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Launched 19:17:33.130529 run osmo-stp_10.42.42.5(pid=5743): Launched 19:17:33.246764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:33.768673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Launched 19:17:33.884473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:34.140059 run patchelf(pid=5746): Launched 19:17:34.308515 run osmo-stp_10.42.42.5(pid=5743): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] 19:17:34.436387 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-09_19:17:33.074541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:34.565419 run osmo-stp_10.42.42.5(pid=5743): stderr: | [0;m[38;5;43m20221209191733244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191733244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191733245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191733245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:34.694973 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-09_19:17:33.074541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:34.818575 run osmo-stp_10.42.42.5(pid=5743): stderr: | [0;m[38;5;43m20221209191733244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191733244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191733245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191733245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191733246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:34.966425 run patchelf(pid=5746): Terminating (SIGINT) 19:17:35.135350 run patchelf(pid=5746): Terminated: ok {rc=0} 19:17:35.256785 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2363↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] [trial-2363↪gprs:trx-umtrx↪ping.py:22] 19:17:35.265947 tst ping.py:22: Test FAILED (6.6 sec) 19:17:35.292325 run osmo-hlr_10.42.42.2(pid=5740): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5740)] 19:17:35.339401 run osmo-hlr_10.42.42.2(pid=5740): stdout: | (launched: 2022-12-09_19:17:32.062750) 19:17:35.387949 run osmo-hlr_10.42.42.2(pid=5740): stderr: | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191732315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191732332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191732340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191732340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191732340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:35.437091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminating (SIGTERM) 19:17:35.476359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminating (SIGTERM) 19:17:35.515521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Terminating (SIGTERM) 19:17:35.554999 --- ParallelTerminationStrategy: PID 5739 died... 19:17:35.573907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminated: ok {rc=0} 19:17:35.617642 --- ParallelTerminationStrategy: PID 5742 died... 19:17:35.636065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminated: ok {rc=0} 19:17:35.679692 --- ParallelTerminationStrategy: PID 5745 died... 19:17:35.698246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Terminated: ok {rc=0} 19:17:35.782498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 19:17:36.873109 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:36.885045 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:17:36.936878 tst ping_idle_ping.py: using LAC 23150 19:17:37.065584 tst ping_idle_ping.py: using RAC 200 19:17:37.194368 tst ping_idle_ping.py: using CellId 23150 19:17:37.322928 tst ping_idle_ping.py: using BVCI 23151 19:17:37.441486 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.452698 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.463944 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.475269 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.486465 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.497635 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.509072 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:17:37.520453 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:37.640508 tst ping_idle_ping.py:24: start network... 19:17:37.845083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:38.320160 run create_hlr_db(pid=5747): Launched 19:17:38.445679 bus /gobi_6: Setting Powered False 19:17:39.506273 run create_hlr_db(pid=5747): Terminated: ok {rc=0} 19:17:39.931366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Launched 19:17:40.239058 run osmo-hlr_10.42.42.2(pid=5750): Launched 19:17:40.358095 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:40.885400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Launched 19:17:41.189878 run osmo-stp_10.42.42.5(pid=5753): Launched 19:17:41.305434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:41.829933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Launched 19:17:41.947243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:42.203475 run patchelf(pid=5756): Launched 19:17:42.372600 run osmo-stp_10.42.42.5(pid=5753): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] 19:17:42.500146 run osmo-stp_10.42.42.5(pid=5753): stdout: | (launched: 2022-12-09_19:17:41.133363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:42.629186 run osmo-stp_10.42.42.5(pid=5753): stderr: | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191741304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:42.758300 run osmo-stp_10.42.42.5(pid=5753): stdout: | (launched: 2022-12-09_19:17:41.133363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:42.881873 run osmo-stp_10.42.42.5(pid=5753): stderr: | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191741304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191741304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191741305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:43.028339 run patchelf(pid=5756): Terminating (SIGINT) 19:17:43.197826 run patchelf(pid=5756): Terminated: ok {rc=0} 19:17:43.319455 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5753): Process ended prematurely: osmo-stp_10.42.42.5(pid=5753) [trial-2363↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] [trial-2363↪gprs:trx-umtrx↪ping_idle_ping.py:27] 19:17:43.328525 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:17:43.354934 run osmo-hlr_10.42.42.2(pid=5750): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5750)] 19:17:43.401611 run osmo-hlr_10.42.42.2(pid=5750): stdout: | (launched: 2022-12-09_19:17:40.182572) 19:17:43.450035 run osmo-hlr_10.42.42.2(pid=5750): stderr: | [0;m[1;31m20221209191740362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191740362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191740362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191740363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191740363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191740363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191740375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191740384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191740384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191740384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:43.498590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Terminating (SIGTERM) 19:17:43.537646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Terminating (SIGTERM) 19:17:43.576814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Terminating (SIGTERM) 19:17:43.616164 --- ParallelTerminationStrategy: PID 5749 died... 19:17:43.634763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Terminated: ok {rc=0} 19:17:43.678032 --- ParallelTerminationStrategy: PID 5752 died... 19:17:43.696363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Terminated: ok {rc=0} 19:17:43.739501 --- ParallelTerminationStrategy: PID 5755 died... 19:17:43.757827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Terminated: ok {rc=0} 19:17:43.839514 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 19:17:45.139281 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:17:45.145586 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:17:45.179996 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:17:45.219952 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:17:45.308853 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:17:45.342589 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:17:45.382340 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:17:45.981539 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:17:46.036203 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.047885 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:17:46.102286 tst cs_paging_gprs_active.py: using LAC 23151 19:17:46.226516 tst cs_paging_gprs_active.py: using RAC 201 19:17:46.351378 tst cs_paging_gprs_active.py: using CellId 23151 19:17:46.477298 tst cs_paging_gprs_active.py: using BVCI 23152 19:17:46.602445 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.614558 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.626321 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.638703 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.651604 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.663372 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.675844 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.688505 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:46.700880 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:17:46.849764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:17:46.990019 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:17:47.206299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:47.522993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5762): Launched 19:17:47.793817 run iperf3-srv_10.42.42.10(pid=5763): Launched 19:17:47.909789 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:17:48.117972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:48.429258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5764): Launched 19:17:48.698934 run iperf3-srv_10.42.42.10(pid=5765): Launched 19:17:48.816310 tst cs_paging_gprs_active.py:38: start network... 19:17:49.023636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:49.501789 run create_hlr_db(pid=5766): Launched 19:17:49.627523 bus /gobi_6: Setting Powered False 19:17:50.689118 run create_hlr_db(pid=5766): Terminated: ok {rc=0} 19:17:51.119295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5768): Launched 19:17:51.428054 run osmo-hlr_10.42.42.2(pid=5769): Launched 19:17:51.545747 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:52.091303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5771): Launched 19:17:52.399608 run osmo-stp_10.42.42.5(pid=5772): Launched 19:17:52.517844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:53.049515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5774): Launched 19:17:53.166737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:53.427212 run patchelf(pid=5775): Launched 19:17:53.598566 run osmo-stp_10.42.42.5(pid=5772): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5772)] 19:17:53.728845 run osmo-stp_10.42.42.5(pid=5772): stdout: | (launched: 2022-12-09_19:17:52.342665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:53.860761 run osmo-stp_10.42.42.5(pid=5772): stderr: | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191752516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:53.992527 run osmo-stp_10.42.42.5(pid=5772): stdout: | (launched: 2022-12-09_19:17:52.342665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:54.118488 run osmo-stp_10.42.42.5(pid=5772): stderr: | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191752515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191752516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191752516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:54.267754 run patchelf(pid=5775): Terminating (SIGINT) 19:17:54.440049 run patchelf(pid=5775): Terminated: ok {rc=0} 19:17:54.565238 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5772): Process ended prematurely: osmo-stp_10.42.42.5(pid=5772) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5772)] [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:17:54.574750 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:17:54.601816 run osmo-hlr_10.42.42.2(pid=5769): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5769)] 19:17:54.648920 run osmo-hlr_10.42.42.2(pid=5769): stdout: | (launched: 2022-12-09_19:17:51.370737) 19:17:54.697475 run osmo-hlr_10.42.42.2(pid=5769): stderr: | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191751551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191751563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191751572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191751572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191751572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:54.746228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5762): Terminating (SIGTERM) 19:17:54.785265 run iperf3-srv_10.42.42.10(pid=5763): Terminating (SIGTERM) 19:17:54.824182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5764): Terminating (SIGTERM) 19:17:54.863227 run iperf3-srv_10.42.42.10(pid=5765): Terminating (SIGTERM) 19:17:54.902080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5768): Terminating (SIGTERM) 19:17:54.941082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5771): Terminating (SIGTERM) 19:17:54.979880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5774): Terminating (SIGTERM) 19:17:55.019082 --- ParallelTerminationStrategy: PID 5762 died... 19:17:55.037883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5762): Terminated: ok {rc=0} 19:17:55.081187 --- ParallelTerminationStrategy: PID 5763 died... 19:17:55.099515 run iperf3-srv_10.42.42.10(pid=5763): Terminated {rc=256} 19:17:55.142573 --- ParallelTerminationStrategy: PID 5764 died... 19:17:55.160825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5764): Terminated: ok {rc=0} 19:17:55.203893 --- ParallelTerminationStrategy: PID 5765 died... 19:17:55.222345 run iperf3-srv_10.42.42.10(pid=5765): Terminated {rc=256} 19:17:55.265341 --- ParallelTerminationStrategy: PID 5768 died... 19:17:55.283728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5768): Terminated: ok {rc=0} 19:17:55.326828 --- ParallelTerminationStrategy: PID 5771 died... 19:17:55.345332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5771): Terminated: ok {rc=0} 19:17:55.390223 --- ParallelTerminationStrategy: PID 5774 died... 19:17:55.408607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5774): Terminated: ok {rc=0} 19:17:55.493658 bus /gobi_0: Setting Powered False 19:17:56.592525 bus /gobi_0: Setting Powered False 19:17:57.708218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:17:58.861089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:58.873376 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:17:58.927742 tst iperf3.py: using LAC 23152 19:17:59.058819 tst iperf3.py: using RAC 202 19:17:59.190356 tst iperf3.py: using CellId 23152 19:17:59.320298 tst iperf3.py: using BVCI 23153 19:17:59.443203 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.454610 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.465786 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.477340 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.488618 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.500174 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.512040 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.523655 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:17:59.535384 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:17:59.657706 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:17:59.883033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:00.216782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5776): Launched 19:18:00.505720 run iperf3-srv_10.42.42.10(pid=5777): Launched 19:18:00.629321 tst iperf3.py:8: start network... 19:18:00.859695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:01.356281 run create_hlr_db(pid=5778): Launched 19:18:01.519378 bus /gobi_6: Setting Powered False 19:18:02.580192 run create_hlr_db(pid=5778): Terminated: ok {rc=0} 19:18:03.054128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5780): Launched 19:18:03.384795 run osmo-hlr_10.42.42.2(pid=5781): Launched 19:18:03.511177 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:04.087796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5783): Launched 19:18:04.419047 run osmo-stp_10.42.42.5(pid=5784): Launched 19:18:04.546170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:05.116629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5786): Launched 19:18:05.244605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:05.524006 run patchelf(pid=5787): Launched 19:18:05.708215 run osmo-stp_10.42.42.5(pid=5784): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5784)] 19:18:05.847621 run osmo-stp_10.42.42.5(pid=5784): stdout: | (launched: 2022-12-09_19:18:04.358722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:05.988165 run osmo-stp_10.42.42.5(pid=5784): stderr: | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191804555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:06.128562 run osmo-stp_10.42.42.5(pid=5784): stdout: | (launched: 2022-12-09_19:18:04.358722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:06.263457 run osmo-stp_10.42.42.5(pid=5784): stderr: | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191804554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191804555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191804555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:06.423307 run patchelf(pid=5787): Terminating (SIGINT) 19:18:06.607548 run patchelf(pid=5787): Terminated: ok {rc=0} 19:18:06.740177 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5784): Process ended prematurely: osmo-stp_10.42.42.5(pid=5784) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5784)] [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 19:18:06.750695 tst iperf3.py:8: Test FAILED (7.9 sec) 19:18:06.779552 run osmo-hlr_10.42.42.2(pid=5781): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5781)] 19:18:06.829927 run osmo-hlr_10.42.42.2(pid=5781): stdout: | (launched: 2022-12-09_19:18:03.324300) 19:18:06.881618 run osmo-hlr_10.42.42.2(pid=5781): stderr: | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191803523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191803536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191803544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191803544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191803544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:06.933697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5776): Terminating (SIGTERM) 19:18:06.975132 run iperf3-srv_10.42.42.10(pid=5777): Terminating (SIGTERM) 19:18:07.016513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5780): Terminating (SIGTERM) 19:18:07.058117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5783): Terminating (SIGTERM) 19:18:07.099469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5786): Terminating (SIGTERM) 19:18:07.141344 --- ParallelTerminationStrategy: PID 5776 died... 19:18:07.161252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5776): Terminated: ok {rc=0} 19:18:07.207668 --- ParallelTerminationStrategy: PID 5777 died... 19:18:07.227052 run iperf3-srv_10.42.42.10(pid=5777): Terminated {rc=256} 19:18:07.272894 --- ParallelTerminationStrategy: PID 5780 died... 19:18:07.292278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5780): Terminated: ok {rc=0} 19:18:07.338283 --- ParallelTerminationStrategy: PID 5783 died... 19:18:07.357555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5783): Terminated: ok {rc=0} 19:18:07.403277 --- ParallelTerminationStrategy: PID 5786 died... 19:18:07.422470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5786): Terminated: ok {rc=0} 19:18:07.509518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:18:08.659612 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:08.671457 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:18:08.722111 tst iperf3m4.py: using LAC 23153 19:18:08.852617 tst iperf3m4.py: using RAC 203 19:18:08.981105 tst iperf3m4.py: using CellId 23153 19:18:09.109733 tst iperf3m4.py: using BVCI 23154 19:18:09.229344 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.240697 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.251778 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.263095 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.274508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.285731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.297065 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.308200 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:09.319604 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:09.440231 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:09.560181 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:09.680082 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:09.800679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:18:10.010844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:10.321207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5788): Launched 19:18:10.590934 run iperf3-srv_10.42.42.10(pid=5789): Launched 19:18:10.706508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:18:10.914423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:11.224747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5790): Launched 19:18:11.492647 run iperf3-srv_10.42.42.10(pid=5791): Launched 19:18:11.607324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:18:11.814077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:12.124102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5792): Launched 19:18:12.392514 run iperf3-srv_10.42.42.10(pid=5793): Launched 19:18:12.507556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:18:12.715547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:13.025786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5794): Launched 19:18:13.294101 run iperf3-srv_10.42.42.10(pid=5795): Launched 19:18:13.409331 tst iperf3m4.py:8: start network... 19:18:13.616211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:14.094915 run create_hlr_db(pid=5796): Launched 19:18:14.222989 bus /gobi_6: Setting Powered False 19:18:15.284550 run create_hlr_db(pid=5796): Terminated: ok {rc=0} 19:18:15.736633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5798): Launched 19:18:16.086035 run osmo-hlr_10.42.42.2(pid=5799): Launched 19:18:16.379849 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:16.975985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5801): Launched 19:18:17.321313 run osmo-stp_10.42.42.5(pid=5802): Launched 19:18:17.449175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:18.022074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5804): Launched 19:18:18.149981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:18.430551 run patchelf(pid=5805): Launched 19:18:18.615695 run osmo-stp_10.42.42.5(pid=5802): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5802)] 19:18:18.755911 run osmo-stp_10.42.42.5(pid=5802): stdout: | (launched: 2022-12-09_19:18:17.260045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:18.897918 run osmo-stp_10.42.42.5(pid=5802): stderr: | [0;m[38;5;43m20221209191817452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191817453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191817453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191817453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:19.039709 run osmo-stp_10.42.42.5(pid=5802): stdout: | (launched: 2022-12-09_19:18:17.260045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:19.175456 run osmo-stp_10.42.42.5(pid=5802): stderr: | [0;m[38;5;43m20221209191817452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191817453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191817453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191817453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:19.336274 run patchelf(pid=5805): Terminating (SIGINT) 19:18:19.521231 run patchelf(pid=5805): Terminated: ok {rc=0} 19:18:19.654570 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5802): Process ended prematurely: osmo-stp_10.42.42.5(pid=5802) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5802)] [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 19:18:19.664914 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:18:19.694382 run osmo-hlr_10.42.42.2(pid=5799): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5799)] 19:18:19.744224 run osmo-hlr_10.42.42.2(pid=5799): stdout: | (launched: 2022-12-09_19:18:16.025688) 19:18:19.795794 run osmo-hlr_10.42.42.2(pid=5799): stderr: | [0;m[1;31m20221209191816216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191816216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191816216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191816216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191816216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191816229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191816240 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191816253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191816253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191816253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:19.848135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5788): Terminating (SIGTERM) 19:18:19.890007 run iperf3-srv_10.42.42.10(pid=5789): Terminating (SIGTERM) 19:18:19.932015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5790): Terminating (SIGTERM) 19:18:19.974022 run iperf3-srv_10.42.42.10(pid=5791): Terminating (SIGTERM) 19:18:20.015999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5792): Terminating (SIGTERM) 19:18:20.058236 run iperf3-srv_10.42.42.10(pid=5793): Terminating (SIGTERM) 19:18:20.100282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5794): Terminating (SIGTERM) 19:18:20.142422 run iperf3-srv_10.42.42.10(pid=5795): Terminating (SIGTERM) 19:18:20.184350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5798): Terminating (SIGTERM) 19:18:20.226428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5801): Terminating (SIGTERM) 19:18:20.268406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5804): Terminating (SIGTERM) 19:18:20.310696 --- ParallelTerminationStrategy: PID 5788 died... 19:18:20.330993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5788): Terminated: ok {rc=0} 19:18:20.377830 --- ParallelTerminationStrategy: PID 5789 died... 19:18:20.397505 run iperf3-srv_10.42.42.10(pid=5789): Terminated {rc=256} 19:18:20.443887 --- ParallelTerminationStrategy: PID 5790 died... 19:18:20.463432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5790): Terminated: ok {rc=0} 19:18:20.509928 --- ParallelTerminationStrategy: PID 5791 died... 19:18:20.529317 run iperf3-srv_10.42.42.10(pid=5791): Terminated {rc=256} 19:18:20.575360 --- ParallelTerminationStrategy: PID 5792 died... 19:18:20.594953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5792): Terminated: ok {rc=0} 19:18:20.641206 --- ParallelTerminationStrategy: PID 5793 died... 19:18:20.660426 run iperf3-srv_10.42.42.10(pid=5793): Terminated {rc=256} 19:18:20.707420 --- ParallelTerminationStrategy: PID 5794 died... 19:18:20.727265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5794): Terminated: ok {rc=0} 19:18:20.773811 --- ParallelTerminationStrategy: PID 5795 died... 19:18:20.793398 run iperf3-srv_10.42.42.10(pid=5795): Terminated {rc=256} 19:18:20.839713 --- ParallelTerminationStrategy: PID 5798 died... 19:18:20.859430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5798): Terminated: ok {rc=0} 19:18:20.906239 --- ParallelTerminationStrategy: PID 5801 died... 19:18:20.925820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5801): Terminated: ok {rc=0} 19:18:20.972318 --- ParallelTerminationStrategy: PID 5804 died... 19:18:20.992000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5804): Terminated: ok {rc=0} 19:18:21.079500 bus /gobi_4: Setting Powered False 19:18:22.178567 bus /gobi_4: Setting Powered False 19:18:23.296242 bus /gobi_1: Setting Powered False 19:18:24.395300 bus /gobi_1: Setting Powered False 19:18:25.511774 bus /gobi_0: Setting Powered False 19:18:26.608758 bus /gobi_0: Setting Powered False 19:18:27.725936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 19:18:28.827727 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:28.840122 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:18:28.893147 tst ping.py: using LAC 23154 19:18:29.021366 tst ping.py: using RAC 204 19:18:29.147918 tst ping.py: using CellId 23154 19:18:29.274669 tst ping.py: using BVCI 23155 19:18:29.393139 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.404574 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.415786 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.427661 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.439501 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.451252 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.463257 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:29.475138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:29.593939 tst ping.py:19: start network... 19:18:29.797741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:30.268910 run create_hlr_db(pid=5806): Launched 19:18:30.393182 bus /gobi_6: Setting Powered False 19:18:31.471413 run create_hlr_db(pid=5806): Terminated: ok {rc=0} 19:18:31.954025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5808): Launched 19:18:32.333582 run osmo-hlr_10.42.42.2(pid=5809): Launched 19:18:32.460654 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:33.027204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5811): Launched 19:18:33.353763 run osmo-stp_10.42.42.5(pid=5812): Launched 19:18:33.478595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:34.040377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5814): Launched 19:18:34.165717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:34.439816 run patchelf(pid=5815): Launched 19:18:34.621468 run osmo-stp_10.42.42.5(pid=5812): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5812)] 19:18:34.758343 run osmo-stp_10.42.42.5(pid=5812): stdout: | (launched: 2022-12-09_19:18:33.293908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:34.897604 run osmo-stp_10.42.42.5(pid=5812): stderr: | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191833490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:35.036411 run osmo-stp_10.42.42.5(pid=5812): stdout: | (launched: 2022-12-09_19:18:33.293908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:35.169134 run osmo-stp_10.42.42.5(pid=5812): stderr: | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191833490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191833490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191833491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:35.326358 run patchelf(pid=5815): Terminating (SIGINT) 19:18:35.506973 run patchelf(pid=5815): Terminated: ok {rc=0} 19:18:35.637314 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5812): Process ended prematurely: osmo-stp_10.42.42.5(pid=5812) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5812)] [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 19:18:35.646939 tst ping.py:22: Test FAILED (6.8 sec) 19:18:35.675509 run osmo-hlr_10.42.42.2(pid=5809): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5809)] 19:18:35.725277 run osmo-hlr_10.42.42.2(pid=5809): stdout: | (launched: 2022-12-09_19:18:32.273616) 19:18:35.776586 run osmo-hlr_10.42.42.2(pid=5809): stderr: | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191832473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191832486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191832495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191832495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191832495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:35.828456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5808): Terminating (SIGTERM) 19:18:35.870394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5811): Terminating (SIGTERM) 19:18:35.912149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5814): Terminating (SIGTERM) 19:18:35.954138 --- ParallelTerminationStrategy: PID 5808 died... 19:18:35.973974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5808): Terminated: ok {rc=0} 19:18:36.020267 --- ParallelTerminationStrategy: PID 5811 died... 19:18:36.039761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5811): Terminated: ok {rc=0} 19:18:36.085893 --- ParallelTerminationStrategy: PID 5814 died... 19:18:36.105459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5814): Terminated: ok {rc=0} 19:18:36.192928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:18:37.280271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.291924 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:18:37.352115 tst ping_idle_ping.py: using LAC 23155 19:18:37.474119 tst ping_idle_ping.py: using RAC 205 19:18:37.594092 tst ping_idle_ping.py: using CellId 23155 19:18:37.714109 tst ping_idle_ping.py: using BVCI 23156 19:18:37.826741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.837821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.848572 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.859623 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.870524 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.881467 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.892569 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:18:37.903519 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:18:38.020432 tst ping_idle_ping.py:24: start network... 19:18:38.226119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:38.701277 run create_hlr_db(pid=5817): Launched 19:18:38.827005 bus /gobi_6: Setting Powered False 19:18:39.888087 run create_hlr_db(pid=5817): Terminated: ok {rc=0} 19:18:40.334799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Launched 19:18:40.663027 run osmo-hlr_10.42.42.2(pid=5820): Launched 19:18:40.789814 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:41.351191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Launched 19:18:41.679025 run osmo-stp_10.42.42.5(pid=5823): Launched 19:18:41.806001 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:42.370530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Launched 19:18:42.495994 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:42.771696 run patchelf(pid=5826): Launched 19:18:42.954543 run osmo-stp_10.42.42.5(pid=5823): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] 19:18:43.091966 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-09_19:18:41.619270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:43.231258 run osmo-stp_10.42.42.5(pid=5823): stderr: | [0;m[38;5;43m20221209191841814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191841815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191841815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191841815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:43.370814 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-09_19:18:41.619270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:43.503998 run osmo-stp_10.42.42.5(pid=5823): stderr: | [0;m[38;5;43m20221209191841814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191841815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191841815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191841815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191841816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:43.662210 run patchelf(pid=5826): Terminating (SIGINT) 19:18:43.844318 run patchelf(pid=5826): Terminated: ok {rc=0} 19:18:43.975365 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 19:18:43.984894 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:18:44.013673 run osmo-hlr_10.42.42.2(pid=5820): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5820)] 19:18:44.063614 run osmo-hlr_10.42.42.2(pid=5820): stdout: | (launched: 2022-12-09_19:18:40.603164) 19:18:44.115395 run osmo-hlr_10.42.42.2(pid=5820): stderr: | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191840804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191840818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191840828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191840828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191840828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:44.167499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminating (SIGTERM) 19:18:44.209389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminating (SIGTERM) 19:18:44.251833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Terminating (SIGTERM) 19:18:44.294934 --- ParallelTerminationStrategy: PID 5819 died... 19:18:44.315456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminated: ok {rc=0} 19:18:44.362589 --- ParallelTerminationStrategy: PID 5822 died... 19:18:44.382432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminated: ok {rc=0} 19:18:44.428609 --- ParallelTerminationStrategy: PID 5825 died... 19:18:44.448723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Terminated: ok {rc=0} 19:18:44.536402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:18:45.853700 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:18:45.866630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:18:45.902806 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:18:45.943869 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:18:46.042105 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:18:46.075652 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:18:46.115418 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:18:46.709650 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:18:46.764082 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:46.775522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:18:46.843502 tst cs_paging_gprs_active.py: using LAC 23156 19:18:46.995150 tst cs_paging_gprs_active.py: using RAC 206 19:18:47.125954 tst cs_paging_gprs_active.py: using CellId 23156 19:18:47.248077 tst cs_paging_gprs_active.py: using BVCI 23157 19:18:47.363405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.374367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.385327 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.396571 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.407946 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.419317 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.430678 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.441880 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:47.453315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:18:47.575448 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:18:47.697436 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:18:47.923929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:48.258964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5830): Launched 19:18:48.549252 run iperf3-srv_10.42.42.10(pid=5831): Launched 19:18:48.675227 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:18:48.899929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:49.233113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5832): Launched 19:18:49.521279 run iperf3-srv_10.42.42.10(pid=5833): Launched 19:18:49.646790 tst cs_paging_gprs_active.py:38: start network... 19:18:49.871361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:50.385084 run create_hlr_db(pid=5834): Launched 19:18:50.513433 bus /gobi_6: Setting Powered False 19:18:51.579605 run create_hlr_db(pid=5834): Terminated: ok {rc=0} 19:18:52.022658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Launched 19:18:52.332059 run osmo-hlr_10.42.42.2(pid=5837): Launched 19:18:52.450622 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:52.983606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Launched 19:18:53.294251 run osmo-stp_10.42.42.5(pid=5840): Launched 19:18:53.411077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:53.944221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5842): Launched 19:18:54.063474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:54.332919 run patchelf(pid=5843): Launched 19:18:54.506317 run osmo-stp_10.42.42.5(pid=5840): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] 19:18:54.637535 run osmo-stp_10.42.42.5(pid=5840): stdout: | (launched: 2022-12-09_19:18:53.237006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:54.770373 run osmo-stp_10.42.42.5(pid=5840): stderr: | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191853413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:54.903305 run osmo-stp_10.42.42.5(pid=5840): stdout: | (launched: 2022-12-09_19:18:53.237006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:55.030820 run osmo-stp_10.42.42.5(pid=5840): stderr: | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191853412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191853413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191853413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:55.181534 run patchelf(pid=5843): Terminating (SIGINT) 19:18:55.354952 run patchelf(pid=5843): Terminated: ok {rc=0} 19:18:55.480425 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5840): Process ended prematurely: osmo-stp_10.42.42.5(pid=5840) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:18:55.490383 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:18:55.517599 run osmo-hlr_10.42.42.2(pid=5837): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5837)] 19:18:55.564690 run osmo-hlr_10.42.42.2(pid=5837): stdout: | (launched: 2022-12-09_19:18:52.275085) 19:18:55.613598 run osmo-hlr_10.42.42.2(pid=5837): stderr: | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191852452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191852468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:55.662761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5830): Terminating (SIGTERM) 19:18:55.702297 run iperf3-srv_10.42.42.10(pid=5831): Terminating (SIGTERM) 19:18:55.741733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5832): Terminating (SIGTERM) 19:18:55.781091 run iperf3-srv_10.42.42.10(pid=5833): Terminating (SIGTERM) 19:18:55.820363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Terminating (SIGTERM) 19:18:55.859916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Terminating (SIGTERM) 19:18:55.899522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5842): Terminating (SIGTERM) 19:18:55.939561 --- ParallelTerminationStrategy: PID 5830 died... 19:18:55.958467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5830): Terminated: ok {rc=0} 19:18:56.002038 --- ParallelTerminationStrategy: PID 5831 died... 19:18:56.020484 run iperf3-srv_10.42.42.10(pid=5831): Terminated {rc=256} 19:18:56.063747 --- ParallelTerminationStrategy: PID 5832 died... 19:18:56.082382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5832): Terminated: ok {rc=0} 19:18:56.125738 --- ParallelTerminationStrategy: PID 5833 died... 19:18:56.144165 run iperf3-srv_10.42.42.10(pid=5833): Terminated {rc=256} 19:18:56.187390 --- ParallelTerminationStrategy: PID 5836 died... 19:18:56.205966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Terminated: ok {rc=0} 19:18:56.249238 --- ParallelTerminationStrategy: PID 5839 died... 19:18:56.267594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Terminated: ok {rc=0} 19:18:56.311457 --- ParallelTerminationStrategy: PID 5842 died... 19:18:56.330040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5842): Terminated: ok {rc=0} 19:18:56.412113 bus /gobi_0: Setting Powered False 19:18:57.508246 bus /gobi_0: Setting Powered False 19:18:58.623504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:18:59.773207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:18:59.785247 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:18:59.855618 tst iperf3.py: using LAC 23157 19:18:59.988228 tst iperf3.py: using RAC 207 19:19:00.117365 tst iperf3.py: using CellId 23157 19:19:00.245385 tst iperf3.py: using BVCI 23158 19:19:00.365886 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.377109 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.388159 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.399443 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.410676 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.421996 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.433582 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.445104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:00.456688 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:00.577221 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:19:00.801841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:01.169725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Launched 19:19:01.466830 run iperf3-srv_10.42.42.10(pid=5845): Launched 19:19:01.625358 tst iperf3.py:8: start network... 19:19:01.882989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:02.403209 run create_hlr_db(pid=5846): Launched 19:19:02.530986 bus /gobi_6: Setting Powered False 19:19:03.595775 run create_hlr_db(pid=5846): Terminated: ok {rc=0} 19:19:04.055762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Launched 19:19:04.387664 run osmo-hlr_10.42.42.2(pid=5849): Launched 19:19:04.514983 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:05.176541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Launched 19:19:05.497816 run osmo-stp_10.42.42.5(pid=5852): Launched 19:19:05.620876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:06.176519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Launched 19:19:06.299237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:06.571757 run patchelf(pid=5855): Launched 19:19:06.750398 run osmo-stp_10.42.42.5(pid=5852): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] 19:19:06.886996 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-09_19:19:05.439034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:07.025091 run osmo-stp_10.42.42.5(pid=5852): stderr: | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191905633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:07.163103 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-09_19:19:05.439034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:07.295156 run osmo-stp_10.42.42.5(pid=5852): stderr: | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191905633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191905633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191905634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:07.451616 run patchelf(pid=5855): Terminating (SIGINT) 19:19:07.632000 run patchelf(pid=5855): Terminated: ok {rc=0} 19:19:07.762097 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 19:19:07.772429 tst iperf3.py:8: Test FAILED (8.0 sec) 19:19:07.801286 run osmo-hlr_10.42.42.2(pid=5849): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5849)] 19:19:07.851231 run osmo-hlr_10.42.42.2(pid=5849): stdout: | (launched: 2022-12-09_19:19:04.327000) 19:19:07.902739 run osmo-hlr_10.42.42.2(pid=5849): stderr: | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191904529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191904542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191904550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191904550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191904550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:07.955050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Terminating (SIGTERM) 19:19:07.996379 run iperf3-srv_10.42.42.10(pid=5845): Terminating (SIGTERM) 19:19:08.037842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminating (SIGTERM) 19:19:08.079279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminating (SIGTERM) 19:19:08.120558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Terminating (SIGTERM) 19:19:08.162414 --- ParallelTerminationStrategy: PID 5844 died... 19:19:08.182049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5844): Terminated: ok {rc=0} 19:19:08.228489 --- ParallelTerminationStrategy: PID 5845 died... 19:19:08.247951 run iperf3-srv_10.42.42.10(pid=5845): Terminated {rc=256} 19:19:08.294156 --- ParallelTerminationStrategy: PID 5848 died... 19:19:08.313716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminated: ok {rc=0} 19:19:08.359608 --- ParallelTerminationStrategy: PID 5851 died... 19:19:08.378970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminated: ok {rc=0} 19:19:08.424844 --- ParallelTerminationStrategy: PID 5854 died... 19:19:08.444507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5854): Terminated: ok {rc=0} 19:19:08.531344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:19:09.680839 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:09.692933 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:19:09.762940 tst iperf3m4.py: using LAC 23158 19:19:09.890888 tst iperf3m4.py: using RAC 208 19:19:10.016251 tst iperf3m4.py: using CellId 23158 19:19:10.142015 tst iperf3m4.py: using BVCI 23159 19:19:10.260479 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.271828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.282837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.294162 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.305415 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.316721 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.328072 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.339224 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:10.350791 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:10.471853 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:10.592416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:10.713834 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:10.829782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:19:11.033063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:11.337322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5856): Launched 19:19:11.600782 run iperf3-srv_10.42.42.10(pid=5857): Launched 19:19:11.713611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:19:11.916065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:12.220674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5858): Launched 19:19:12.484139 run iperf3-srv_10.42.42.10(pid=5859): Launched 19:19:12.597064 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:19:12.799457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:13.103922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5860): Launched 19:19:13.368070 run iperf3-srv_10.42.42.10(pid=5861): Launched 19:19:13.482160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:19:13.684161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:13.987497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5862): Launched 19:19:14.249494 run iperf3-srv_10.42.42.10(pid=5863): Launched 19:19:14.362505 tst iperf3m4.py:8: start network... 19:19:14.564664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:15.034955 run create_hlr_db(pid=5864): Launched 19:19:15.159961 bus /gobi_6: Setting Powered False 19:19:16.218624 run create_hlr_db(pid=5864): Terminated: ok {rc=0} 19:19:16.647194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5866): Launched 19:19:16.965397 run osmo-hlr_10.42.42.2(pid=5867): Launched 19:19:17.213663 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:17.732593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5869): Launched 19:19:18.034608 run osmo-stp_10.42.42.5(pid=5870): Launched 19:19:18.150319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:18.671094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5872): Launched 19:19:18.785788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:19.041468 run patchelf(pid=5873): Launched 19:19:19.209482 run osmo-stp_10.42.42.5(pid=5870): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5870)] 19:19:19.336659 run osmo-stp_10.42.42.5(pid=5870): stdout: | (launched: 2022-12-09_19:19:17.978791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:19.465986 run osmo-stp_10.42.42.5(pid=5870): stderr: | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191918149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:19.595156 run osmo-stp_10.42.42.5(pid=5870): stdout: | (launched: 2022-12-09_19:19:17.978791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:19.718477 run osmo-stp_10.42.42.5(pid=5870): stderr: | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191918148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191918149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191918149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:19.864622 run patchelf(pid=5873): Terminating (SIGINT) 19:19:20.033352 run patchelf(pid=5873): Terminated: ok {rc=0} 19:19:20.155116 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5870): Process ended prematurely: osmo-stp_10.42.42.5(pid=5870) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5870)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:19:20.164891 tst iperf3m4.py:8: Test FAILED (10.5 sec) 19:19:20.192237 run osmo-hlr_10.42.42.2(pid=5867): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5867)] 19:19:20.239037 run osmo-hlr_10.42.42.2(pid=5867): stdout: | (launched: 2022-12-09_19:19:16.908698) 19:19:20.287668 run osmo-hlr_10.42.42.2(pid=5867): stderr: | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191917160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191917173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191917189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191917189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191917189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:20.336705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5856): Terminating (SIGTERM) 19:19:20.375967 run iperf3-srv_10.42.42.10(pid=5857): Terminating (SIGTERM) 19:19:20.414996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5858): Terminating (SIGTERM) 19:19:20.454366 run iperf3-srv_10.42.42.10(pid=5859): Terminating (SIGTERM) 19:19:20.493381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5860): Terminating (SIGTERM) 19:19:20.533114 run iperf3-srv_10.42.42.10(pid=5861): Terminating (SIGTERM) 19:19:20.571935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5862): Terminating (SIGTERM) 19:19:20.611377 run iperf3-srv_10.42.42.10(pid=5863): Terminating (SIGTERM) 19:19:20.650949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5866): Terminating (SIGTERM) 19:19:20.690359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5869): Terminating (SIGTERM) 19:19:20.729507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5872): Terminating (SIGTERM) 19:19:20.768926 --- ParallelTerminationStrategy: PID 5856 died... 19:19:20.787754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5856): Terminated: ok {rc=0} 19:19:20.831248 --- ParallelTerminationStrategy: PID 5857 died... 19:19:20.849496 run iperf3-srv_10.42.42.10(pid=5857): Terminated {rc=256} 19:19:20.892671 --- ParallelTerminationStrategy: PID 5858 died... 19:19:20.910899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5858): Terminated: ok {rc=0} 19:19:20.954014 --- ParallelTerminationStrategy: PID 5859 died... 19:19:20.972464 run iperf3-srv_10.42.42.10(pid=5859): Terminated {rc=256} 19:19:21.015863 --- ParallelTerminationStrategy: PID 5860 died... 19:19:21.034297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5860): Terminated: ok {rc=0} 19:19:21.077885 --- ParallelTerminationStrategy: PID 5861 died... 19:19:21.096210 run iperf3-srv_10.42.42.10(pid=5861): Terminated {rc=256} 19:19:21.140377 --- ParallelTerminationStrategy: PID 5862 died... 19:19:21.159055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5862): Terminated: ok {rc=0} 19:19:21.202642 --- ParallelTerminationStrategy: PID 5863 died... 19:19:21.221158 run iperf3-srv_10.42.42.10(pid=5863): Terminated {rc=256} 19:19:21.264760 --- ParallelTerminationStrategy: PID 5866 died... 19:19:21.283239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5866): Terminated: ok {rc=0} 19:19:21.326846 --- ParallelTerminationStrategy: PID 5869 died... 19:19:21.345301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5869): Terminated: ok {rc=0} 19:19:21.388766 --- ParallelTerminationStrategy: PID 5872 died... 19:19:21.407313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5872): Terminated: ok {rc=0} 19:19:21.492228 bus /gobi_4: Setting Powered False 19:19:22.591552 bus /gobi_4: Setting Powered False 19:19:23.706833 bus /gobi_1: Setting Powered False 19:19:24.805161 bus /gobi_1: Setting Powered False 19:19:25.916879 bus /gobi_0: Setting Powered False 19:19:27.011325 bus /gobi_0: Setting Powered False 19:19:28.124363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:19:29.229504 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.241337 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:19:29.312180 tst ping.py: using LAC 23159 19:19:29.436801 tst ping.py: using RAC 209 19:19:29.561400 tst ping.py: using CellId 23159 19:19:29.688094 tst ping.py: using BVCI 23160 19:19:29.803455 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.814828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.825993 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.837357 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.849055 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.860335 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.872495 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:29.884474 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:30.003082 tst ping.py:19: start network... 19:19:30.218381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:30.715011 run create_hlr_db(pid=5875): Launched 19:19:30.842198 bus /gobi_6: Setting Powered False 19:19:31.908549 run create_hlr_db(pid=5875): Terminated: ok {rc=0} 19:19:32.366519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5877): Launched 19:19:32.687628 run osmo-hlr_10.42.42.2(pid=5878): Launched 19:19:32.811041 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:33.360806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5880): Launched 19:19:33.679365 run osmo-stp_10.42.42.5(pid=5881): Launched 19:19:33.800517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:34.350867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5883): Launched 19:19:34.473440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:34.742221 run patchelf(pid=5884): Launched 19:19:34.920710 run osmo-stp_10.42.42.5(pid=5881): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5881)] 19:19:35.055299 run osmo-stp_10.42.42.5(pid=5881): stdout: | (launched: 2022-12-09_19:19:33.620550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:35.191715 run osmo-stp_10.42.42.5(pid=5881): stderr: | [0;m[38;5;43m20221209191933812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191933812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191933813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191933813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:35.328843 run osmo-stp_10.42.42.5(pid=5881): stdout: | (launched: 2022-12-09_19:19:33.620550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:35.459248 run osmo-stp_10.42.42.5(pid=5881): stderr: | [0;m[38;5;43m20221209191933812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191933812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191933813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191933813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191933814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:35.613992 run patchelf(pid=5884): Terminating (SIGINT) 19:19:35.791133 run patchelf(pid=5884): Terminated: ok {rc=0} 19:19:35.919678 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5881): Process ended prematurely: osmo-stp_10.42.42.5(pid=5881) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5881)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 19:19:35.929416 tst ping.py:22: Test FAILED (6.7 sec) 19:19:35.957791 run osmo-hlr_10.42.42.2(pid=5878): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5878)] 19:19:36.007615 run osmo-hlr_10.42.42.2(pid=5878): stdout: | (launched: 2022-12-09_19:19:32.628889) 19:19:36.059379 run osmo-hlr_10.42.42.2(pid=5878): stderr: | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191932825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191932837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191932846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191932846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191932846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:36.111424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5877): Terminating (SIGTERM) 19:19:36.153381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5880): Terminating (SIGTERM) 19:19:36.195526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5883): Terminating (SIGTERM) 19:19:36.237829 --- ParallelTerminationStrategy: PID 5877 died... 19:19:36.257715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5877): Terminated: ok {rc=0} 19:19:36.304275 --- ParallelTerminationStrategy: PID 5880 died... 19:19:36.323848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5880): Terminated: ok {rc=0} 19:19:36.370031 --- ParallelTerminationStrategy: PID 5883 died... 19:19:36.389495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5883): Terminated: ok {rc=0} 19:19:36.477471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:19:37.565469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:37.578062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:19:37.651730 tst ping_idle_ping.py: using LAC 23160 19:19:37.777324 tst ping_idle_ping.py: using RAC 210 19:19:37.901189 tst ping_idle_ping.py: using CellId 23160 19:19:38.027038 tst ping_idle_ping.py: using BVCI 23161 19:19:38.143713 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.155044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.166557 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.178032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.189228 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.200451 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.211977 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:19:38.223220 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:19:38.337941 tst ping_idle_ping.py:24: start network... 19:19:38.537463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:38.999893 run create_hlr_db(pid=5885): Launched 19:19:39.121845 bus /gobi_6: Setting Powered False 19:19:40.181241 run create_hlr_db(pid=5885): Terminated: ok {rc=0} 19:19:40.598121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5887): Launched 19:19:40.896215 run osmo-hlr_10.42.42.2(pid=5888): Launched 19:19:41.011012 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:41.539009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5890): Launched 19:19:41.838753 run osmo-stp_10.42.42.5(pid=5891): Launched 19:19:41.952048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:42.466457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5893): Launched 19:19:42.579195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:42.830829 run patchelf(pid=5894): Launched 19:19:42.997165 run osmo-stp_10.42.42.5(pid=5891): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5891)] 19:19:43.123171 run osmo-stp_10.42.42.5(pid=5891): stdout: | (launched: 2022-12-09_19:19:41.782897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:43.250805 run osmo-stp_10.42.42.5(pid=5891): stderr: | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191941955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:43.379037 run osmo-stp_10.42.42.5(pid=5891): stdout: | (launched: 2022-12-09_19:19:41.782897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:43.500920 run osmo-stp_10.42.42.5(pid=5891): stderr: | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191941955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191941955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191941956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:43.645666 run patchelf(pid=5894): Terminating (SIGINT) 19:19:43.812359 run patchelf(pid=5894): Terminated: ok {rc=0} 19:19:43.932619 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5891): Process ended prematurely: osmo-stp_10.42.42.5(pid=5891) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5891)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:19:43.941812 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:19:43.968035 run osmo-hlr_10.42.42.2(pid=5888): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5888)] 19:19:44.014855 run osmo-hlr_10.42.42.2(pid=5888): stdout: | (launched: 2022-12-09_19:19:40.841029) 19:19:44.063437 run osmo-hlr_10.42.42.2(pid=5888): stderr: | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191941019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191941031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191941042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191941042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191941042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:44.112211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5887): Terminating (SIGTERM) 19:19:44.151229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5890): Terminating (SIGTERM) 19:19:44.190241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5893): Terminating (SIGTERM) 19:19:44.229359 --- ParallelTerminationStrategy: PID 5887 died... 19:19:44.247940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5887): Terminated: ok {rc=0} 19:19:44.291209 --- ParallelTerminationStrategy: PID 5890 died... 19:19:44.309417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5890): Terminated: ok {rc=0} 19:19:44.352483 --- ParallelTerminationStrategy: PID 5893 died... 19:19:44.370786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5893): Terminated: ok {rc=0} 19:19:44.455082 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:19:45.764422 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:45.771318 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:19:45.806602 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:19:45.847244 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:19:45.949549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:19:46.000570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:19:46.041591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:19:46.622880 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:19:46.678426 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:46.690535 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:19:46.768474 tst cs_paging_gprs_active.py: using LAC 23161 19:19:46.910212 tst cs_paging_gprs_active.py: using RAC 211 19:19:47.074820 tst cs_paging_gprs_active.py: using CellId 23161 19:19:47.209097 tst cs_paging_gprs_active.py: using BVCI 23162 19:19:47.329677 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.340924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.352237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.363856 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.375601 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.387324 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.398589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.409769 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:47.421279 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:19:47.539550 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:19:47.663330 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:19:47.883725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:48.209693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Launched 19:19:48.491723 run iperf3-srv_10.42.42.10(pid=5899): Launched 19:19:48.613507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:19:48.832562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:49.159302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Launched 19:19:49.442686 run iperf3-srv_10.42.42.10(pid=5901): Launched 19:19:49.566122 tst cs_paging_gprs_active.py:38: start network... 19:19:49.785064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:50.288052 run create_hlr_db(pid=5902): Launched 19:19:50.415445 bus /gobi_6: Setting Powered False 19:19:51.475857 run create_hlr_db(pid=5902): Terminated: ok {rc=0} 19:19:51.919453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Launched 19:19:52.245689 run osmo-hlr_10.42.42.2(pid=5905): Launched 19:19:52.371890 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:52.929512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Launched 19:19:53.254326 run osmo-stp_10.42.42.5(pid=5908): Launched 19:19:53.379426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:53.939315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Launched 19:19:54.064084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:54.340499 run patchelf(pid=5911): Launched 19:19:54.521487 run osmo-stp_10.42.42.5(pid=5908): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] 19:19:54.659018 run osmo-stp_10.42.42.5(pid=5908): stdout: | (launched: 2022-12-09_19:19:53.195001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:54.797876 run osmo-stp_10.42.42.5(pid=5908): stderr: | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191953391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:54.937394 run osmo-stp_10.42.42.5(pid=5908): stdout: | (launched: 2022-12-09_19:19:53.195001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:55.070890 run osmo-stp_10.42.42.5(pid=5908): stderr: | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209191953390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209191953391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209191953391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:55.228299 run patchelf(pid=5911): Terminating (SIGINT) 19:19:55.410289 run patchelf(pid=5911): Terminated: ok {rc=0} 19:19:55.541663 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5908): Process ended prematurely: osmo-stp_10.42.42.5(pid=5908) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:19:55.552040 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:19:55.580694 run osmo-hlr_10.42.42.2(pid=5905): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5905)] 19:19:55.630621 run osmo-hlr_10.42.42.2(pid=5905): stdout: | (launched: 2022-12-09_19:19:52.186136) 19:19:55.681725 run osmo-hlr_10.42.42.2(pid=5905): stderr: | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209191952383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209191952396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209191952404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209191952404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209191952404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:55.733497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Terminating (SIGTERM) 19:19:55.775049 run iperf3-srv_10.42.42.10(pid=5899): Terminating (SIGTERM) 19:19:55.816301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Terminating (SIGTERM) 19:19:55.857756 run iperf3-srv_10.42.42.10(pid=5901): Terminating (SIGTERM) 19:19:55.899275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Terminating (SIGTERM) 19:19:55.940714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Terminating (SIGTERM) 19:19:55.981960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Terminating (SIGTERM) 19:19:56.023472 --- ParallelTerminationStrategy: PID 5898 died... 19:19:56.043208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Terminated: ok {rc=0} 19:19:56.089390 --- ParallelTerminationStrategy: PID 5899 died... 19:19:56.108379 run iperf3-srv_10.42.42.10(pid=5899): Terminated {rc=256} 19:19:56.154384 --- ParallelTerminationStrategy: PID 5900 died... 19:19:56.173556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Terminated: ok {rc=0} 19:19:56.219337 --- ParallelTerminationStrategy: PID 5901 died... 19:19:56.238473 run iperf3-srv_10.42.42.10(pid=5901): Terminated {rc=256} 19:19:56.284208 --- ParallelTerminationStrategy: PID 5904 died... 19:19:56.303401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Terminated: ok {rc=0} 19:19:56.349154 --- ParallelTerminationStrategy: PID 5907 died... 19:19:56.368293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Terminated: ok {rc=0} 19:19:56.414141 --- ParallelTerminationStrategy: PID 5910 died... 19:19:56.433346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Terminated: ok {rc=0} 19:19:56.521580 bus /gobi_0: Setting Powered False 19:19:57.619704 bus /gobi_0: Setting Powered False 19:19:58.737706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:19:59.882733 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:19:59.894440 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:19:59.964196 tst iperf3.py: using LAC 23162 19:20:00.084519 tst iperf3.py: using RAC 212 19:20:00.204070 tst iperf3.py: using CellId 23162 19:20:00.332294 tst iperf3.py: using BVCI 23163 19:20:00.451814 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.463365 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.474670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.486297 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.497757 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.509090 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.520304 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.532317 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:00.544090 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:00.660080 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:20:00.878359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:01.214184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Launched 19:20:01.526693 run iperf3-srv_10.42.42.10(pid=5918): Launched 19:20:01.685347 tst iperf3.py:8: start network... 19:20:01.900005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:02.392658 run create_hlr_db(pid=5919): Launched 19:20:02.517565 bus /gobi_6: Setting Powered False 19:20:03.581796 run create_hlr_db(pid=5919): Terminated: ok {rc=0} 19:20:04.014839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5921): Launched 19:20:04.317066 run osmo-hlr_10.42.42.2(pid=5922): Launched 19:20:04.431474 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:04.956658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5924): Launched 19:20:05.260239 run osmo-stp_10.42.42.5(pid=5925): Launched 19:20:05.375687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:05.900769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5927): Launched 19:20:06.018762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:06.274944 run patchelf(pid=5928): Launched 19:20:06.443088 run osmo-stp_10.42.42.5(pid=5925): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5925)] 19:20:06.571155 run osmo-stp_10.42.42.5(pid=5925): stdout: | (launched: 2022-12-09_19:20:05.204118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:06.700624 run osmo-stp_10.42.42.5(pid=5925): stderr: | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192005376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:06.830570 run osmo-stp_10.42.42.5(pid=5925): stdout: | (launched: 2022-12-09_19:20:05.204118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:06.954373 run osmo-stp_10.42.42.5(pid=5925): stderr: | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192005375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192005376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192005376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:07.101643 run patchelf(pid=5928): Terminating (SIGINT) 19:20:07.272142 run patchelf(pid=5928): Terminated: ok {rc=0} 19:20:07.394756 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5925): Process ended prematurely: osmo-stp_10.42.42.5(pid=5925) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5925)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 19:20:07.404337 tst iperf3.py:8: Test FAILED (7.6 sec) 19:20:07.431222 run osmo-hlr_10.42.42.2(pid=5922): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5922)] 19:20:07.478351 run osmo-hlr_10.42.42.2(pid=5922): stdout: | (launched: 2022-12-09_19:20:04.261391) 19:20:07.527527 run osmo-hlr_10.42.42.2(pid=5922): stderr: | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192004438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192004451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192004462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192004462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192004462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:07.576672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminating (SIGTERM) 19:20:07.615710 run iperf3-srv_10.42.42.10(pid=5918): Terminating (SIGTERM) 19:20:07.654709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5921): Terminating (SIGTERM) 19:20:07.694357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5924): Terminating (SIGTERM) 19:20:07.733474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5927): Terminating (SIGTERM) 19:20:07.773138 --- ParallelTerminationStrategy: PID 5914 died... 19:20:07.791776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminated: ok {rc=0} 19:20:07.835034 --- ParallelTerminationStrategy: PID 5918 died... 19:20:07.853309 run iperf3-srv_10.42.42.10(pid=5918): Terminated {rc=256} 19:20:07.896320 --- ParallelTerminationStrategy: PID 5921 died... 19:20:07.914528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5921): Terminated: ok {rc=0} 19:20:07.957666 --- ParallelTerminationStrategy: PID 5924 died... 19:20:07.975801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5924): Terminated: ok {rc=0} 19:20:08.018899 --- ParallelTerminationStrategy: PID 5927 died... 19:20:08.037259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5927): Terminated: ok {rc=0} 19:20:08.121293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:20:09.268574 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.280157 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:20:09.349042 tst iperf3m4.py: using LAC 23163 19:20:09.467844 tst iperf3m4.py: using RAC 213 19:20:09.588745 tst iperf3m4.py: using CellId 23163 19:20:09.711822 tst iperf3m4.py: using BVCI 23164 19:20:09.823987 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.834838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.845543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.856128 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.866644 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.877237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.887923 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.898435 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:09.909207 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:10.028882 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:10.148051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:10.265799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:10.383678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:20:10.588257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:10.893496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5929): Launched 19:20:11.157625 run iperf3-srv_10.42.42.10(pid=5930): Launched 19:20:11.270886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:20:11.474426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:11.780701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5931): Launched 19:20:12.044228 run iperf3-srv_10.42.42.10(pid=5932): Launched 19:20:12.157246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:20:12.360598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:12.665482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5933): Launched 19:20:12.929581 run iperf3-srv_10.42.42.10(pid=5934): Launched 19:20:13.044571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:20:13.247222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:13.551533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5935): Launched 19:20:13.815545 run iperf3-srv_10.42.42.10(pid=5936): Launched 19:20:13.928363 tst iperf3m4.py:8: start network... 19:20:14.131260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:14.601574 run create_hlr_db(pid=5937): Launched 19:20:14.723969 bus /gobi_6: Setting Powered False 19:20:15.785268 run create_hlr_db(pid=5937): Terminated: ok {rc=0} 19:20:16.250439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Launched 19:20:16.573841 run osmo-hlr_10.42.42.2(pid=5940): Launched 19:20:16.884041 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:17.447619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Launched 19:20:17.752047 run osmo-stp_10.42.42.5(pid=5943): Launched 19:20:17.866362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:18.390766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Launched 19:20:18.507846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:18.766419 run patchelf(pid=5946): Launched 19:20:18.934822 run osmo-stp_10.42.42.5(pid=5943): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] 19:20:19.062872 run osmo-stp_10.42.42.5(pid=5943): stdout: | (launched: 2022-12-09_19:20:17.696141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:19.192499 run osmo-stp_10.42.42.5(pid=5943): stderr: | [0;m[38;5;43m20221209192017867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192017868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192017868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192017868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:19.322325 run osmo-stp_10.42.42.5(pid=5943): stdout: | (launched: 2022-12-09_19:20:17.696141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:19.446347 run osmo-stp_10.42.42.5(pid=5943): stderr: | [0;m[38;5;43m20221209192017867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192017868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192017868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192017868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192017869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:19.593434 run patchelf(pid=5946): Terminating (SIGINT) 19:20:19.763696 run patchelf(pid=5946): Terminated: ok {rc=0} 19:20:19.886328 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5943): Process ended prematurely: osmo-stp_10.42.42.5(pid=5943) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:20:19.895840 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:20:19.922956 run osmo-hlr_10.42.42.2(pid=5940): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5940)] 19:20:19.970324 run osmo-hlr_10.42.42.2(pid=5940): stdout: | (launched: 2022-12-09_19:20:16.516689) 19:20:20.019334 run osmo-hlr_10.42.42.2(pid=5940): stderr: | [0;m[1;31m20221209192016735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192016735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192016735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192016736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192016736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192016736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192016755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192016771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192016771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192016771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:20.069351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5929): Terminating (SIGTERM) 19:20:20.109062 run iperf3-srv_10.42.42.10(pid=5930): Terminating (SIGTERM) 19:20:20.148689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5931): Terminating (SIGTERM) 19:20:20.188226 run iperf3-srv_10.42.42.10(pid=5932): Terminating (SIGTERM) 19:20:20.227519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5933): Terminating (SIGTERM) 19:20:20.266923 run iperf3-srv_10.42.42.10(pid=5934): Terminating (SIGTERM) 19:20:20.306224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5935): Terminating (SIGTERM) 19:20:20.345528 run iperf3-srv_10.42.42.10(pid=5936): Terminating (SIGTERM) 19:20:20.384706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Terminating (SIGTERM) 19:20:20.424144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Terminating (SIGTERM) 19:20:20.463534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Terminating (SIGTERM) 19:20:20.503288 --- ParallelTerminationStrategy: PID 5929 died... 19:20:20.522263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5929): Terminated: ok {rc=0} 19:20:20.565881 --- ParallelTerminationStrategy: PID 5930 died... 19:20:20.584168 run iperf3-srv_10.42.42.10(pid=5930): Terminated {rc=256} 19:20:20.628030 --- ParallelTerminationStrategy: PID 5931 died... 19:20:20.646487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5931): Terminated: ok {rc=0} 19:20:20.690200 --- ParallelTerminationStrategy: PID 5932 died... 19:20:20.708774 run iperf3-srv_10.42.42.10(pid=5932): Terminated {rc=256} 19:20:20.752333 --- ParallelTerminationStrategy: PID 5933 died... 19:20:20.770880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5933): Terminated: ok {rc=0} 19:20:20.815129 --- ParallelTerminationStrategy: PID 5934 died... 19:20:20.833595 run iperf3-srv_10.42.42.10(pid=5934): Terminated {rc=256} 19:20:20.877289 --- ParallelTerminationStrategy: PID 5935 died... 19:20:20.895783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5935): Terminated: ok {rc=0} 19:20:20.939373 --- ParallelTerminationStrategy: PID 5936 died... 19:20:20.957964 run iperf3-srv_10.42.42.10(pid=5936): Terminated {rc=256} 19:20:21.001648 --- ParallelTerminationStrategy: PID 5939 died... 19:20:21.020038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Terminated: ok {rc=0} 19:20:21.063724 --- ParallelTerminationStrategy: PID 5942 died... 19:20:21.082298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Terminated: ok {rc=0} 19:20:21.125853 --- ParallelTerminationStrategy: PID 5945 died... 19:20:21.144289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Terminated: ok {rc=0} 19:20:21.227868 bus /gobi_4: Setting Powered False 19:20:22.326075 bus /gobi_4: Setting Powered False 19:20:23.443380 bus /gobi_1: Setting Powered False 19:20:24.542136 bus /gobi_1: Setting Powered False 19:20:25.656211 bus /gobi_0: Setting Powered False 19:20:26.754693 bus /gobi_0: Setting Powered False 19:20:27.870420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:20:28.973915 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:28.986261 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:20:29.058234 tst ping.py: using LAC 23164 19:20:29.184316 tst ping.py: using RAC 214 19:20:29.308789 tst ping.py: using CellId 23164 19:20:29.435252 tst ping.py: using BVCI 23165 19:20:29.547066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.558628 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.570275 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.581548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.592121 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.602955 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.613657 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:29.624200 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:29.738657 tst ping.py:19: start network... 19:20:29.938997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:30.404877 run create_hlr_db(pid=5947): Launched 19:20:30.527629 bus /gobi_6: Setting Powered False 19:20:31.586342 run create_hlr_db(pid=5947): Terminated: ok {rc=0} 19:20:32.025695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Launched 19:20:32.334353 run osmo-hlr_10.42.42.2(pid=5950): Launched 19:20:32.452803 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:32.979813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Launched 19:20:33.277469 run osmo-stp_10.42.42.5(pid=5953): Launched 19:20:33.391264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:33.906387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Launched 19:20:34.021965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:34.274445 run patchelf(pid=5956): Launched 19:20:34.441583 run osmo-stp_10.42.42.5(pid=5953): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] 19:20:34.567680 run osmo-stp_10.42.42.5(pid=5953): stdout: | (launched: 2022-12-09_19:20:33.222392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:34.695150 run osmo-stp_10.42.42.5(pid=5953): stderr: | [0;m[38;5;43m20221209192033393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192033393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192033394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192033394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192033394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192033395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192033395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:34.822678 run osmo-stp_10.42.42.5(pid=5953): stdout: | (launched: 2022-12-09_19:20:33.222392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:34.944622 run osmo-stp_10.42.42.5(pid=5953): stderr: | [0;m[38;5;43m20221209192033393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192033393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192033394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192033394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192033394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192033395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192033395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:35.089311 run patchelf(pid=5956): Terminating (SIGINT) 19:20:35.255393 run patchelf(pid=5956): Terminated: ok {rc=0} 19:20:35.375142 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5953): Process ended prematurely: osmo-stp_10.42.42.5(pid=5953) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 19:20:35.384078 tst ping.py:22: Test FAILED (6.4 sec) 19:20:35.410613 run osmo-hlr_10.42.42.2(pid=5950): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5950)] 19:20:35.457544 run osmo-hlr_10.42.42.2(pid=5950): stdout: | (launched: 2022-12-09_19:20:32.278603) 19:20:35.506079 run osmo-hlr_10.42.42.2(pid=5950): stderr: | [0;m[1;31m20221209192032454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192032454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192032454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192032455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192032455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192032455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192032466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192032476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192032476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192032476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:35.555224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Terminating (SIGTERM) 19:20:35.594818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Terminating (SIGTERM) 19:20:35.634158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Terminating (SIGTERM) 19:20:35.673777 --- ParallelTerminationStrategy: PID 5949 died... 19:20:35.692499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Terminated: ok {rc=0} 19:20:35.737267 --- ParallelTerminationStrategy: PID 5952 died... 19:20:35.756013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Terminated: ok {rc=0} 19:20:35.799472 --- ParallelTerminationStrategy: PID 5955 died... 19:20:35.817938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Terminated: ok {rc=0} 19:20:35.902720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:20:36.991921 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.003954 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:20:37.075425 tst ping_idle_ping.py: using LAC 23165 19:20:37.193082 tst ping_idle_ping.py: using RAC 215 19:20:37.313099 tst ping_idle_ping.py: using CellId 23165 19:20:37.433433 tst ping_idle_ping.py: using BVCI 23166 19:20:37.543148 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.554068 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.564700 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.575335 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.585962 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.596507 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.607346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:20:37.617957 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:20:37.732711 tst ping_idle_ping.py:24: start network... 19:20:37.939110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:38.403678 run create_hlr_db(pid=5957): Launched 19:20:38.525647 bus /gobi_6: Setting Powered False 19:20:39.585695 run create_hlr_db(pid=5957): Terminated: ok {rc=0} 19:20:40.004637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5959): Launched 19:20:40.304001 run osmo-hlr_10.42.42.2(pid=5960): Launched 19:20:40.417895 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:40.931762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5962): Launched 19:20:41.232459 run osmo-stp_10.42.42.5(pid=5963): Launched 19:20:41.346361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:41.863376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5965): Launched 19:20:41.977166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:42.230024 run patchelf(pid=5966): Launched 19:20:42.395331 run osmo-stp_10.42.42.5(pid=5963): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5963)] 19:20:42.521799 run osmo-stp_10.42.42.5(pid=5963): stdout: | (launched: 2022-12-09_19:20:41.176861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:42.650245 run osmo-stp_10.42.42.5(pid=5963): stderr: | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192041349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:42.778059 run osmo-stp_10.42.42.5(pid=5963): stdout: | (launched: 2022-12-09_19:20:41.176861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:42.900331 run osmo-stp_10.42.42.5(pid=5963): stderr: | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192041348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192041349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192041349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:43.045529 run patchelf(pid=5966): Terminating (SIGINT) 19:20:43.213572 run patchelf(pid=5966): Terminated: ok {rc=0} 19:20:43.334500 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5963): Process ended prematurely: osmo-stp_10.42.42.5(pid=5963) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5963)] [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:20:43.343432 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:20:43.370000 run osmo-hlr_10.42.42.2(pid=5960): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5960)] 19:20:43.417151 run osmo-hlr_10.42.42.2(pid=5960): stdout: | (launched: 2022-12-09_19:20:40.248617) 19:20:43.465828 run osmo-hlr_10.42.42.2(pid=5960): stderr: | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192040427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192040439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192040448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192040449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192040449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:43.514804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5959): Terminating (SIGTERM) 19:20:43.553973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5962): Terminating (SIGTERM) 19:20:43.593187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5965): Terminating (SIGTERM) 19:20:43.632436 --- ParallelTerminationStrategy: PID 5959 died... 19:20:43.651004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5959): Terminated: ok {rc=0} 19:20:43.694314 --- ParallelTerminationStrategy: PID 5962 died... 19:20:43.712555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5962): Terminated: ok {rc=0} 19:20:43.755775 --- ParallelTerminationStrategy: PID 5965 died... 19:20:43.774105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5965): Terminated: ok {rc=0} 19:20:43.859288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:20:45.172775 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:20:45.180384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:20:45.212550 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:20:45.250155 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:20:45.343120 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:20:45.375103 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:20:45.412514 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:20:46.077403 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:20:46.149928 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.165726 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:20:46.229157 tst cs_paging_gprs_active.py: using LAC 23166 19:20:46.362177 tst cs_paging_gprs_active.py: using RAC 216 19:20:46.495925 tst cs_paging_gprs_active.py: using CellId 23166 19:20:46.619427 tst cs_paging_gprs_active.py: using BVCI 23167 19:20:46.732341 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.744416 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.756455 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.768684 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.781921 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.794139 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.806365 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.818441 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:46.831430 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:20:46.949164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:20:47.099144 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:20:47.308116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:47.615906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5970): Launched 19:20:47.882235 run iperf3-srv_10.42.42.10(pid=5971): Launched 19:20:47.995960 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:20:48.200747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:48.506295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5972): Launched 19:20:48.772279 run iperf3-srv_10.42.42.10(pid=5973): Launched 19:20:48.885745 tst cs_paging_gprs_active.py:38: start network... 19:20:49.089797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:49.562205 run create_hlr_db(pid=5974): Launched 19:20:49.686391 bus /gobi_6: Setting Powered False 19:20:50.747291 run create_hlr_db(pid=5974): Terminated: ok {rc=0} 19:20:51.192189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5976): Launched 19:20:51.517002 run osmo-hlr_10.42.42.2(pid=5977): Launched 19:20:51.642687 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:52.208180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5979): Launched 19:20:52.533503 run osmo-stp_10.42.42.5(pid=5980): Launched 19:20:52.658476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:53.222685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5982): Launched 19:20:53.348259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:53.624003 run patchelf(pid=5983): Launched 19:20:53.805658 run osmo-stp_10.42.42.5(pid=5980): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5980)] 19:20:53.944131 run osmo-stp_10.42.42.5(pid=5980): stdout: | (launched: 2022-12-09_19:20:52.473522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:54.083505 run osmo-stp_10.42.42.5(pid=5980): stderr: | [0;m[38;5;43m20221209192052666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192052666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192052667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192052667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:54.223001 run osmo-stp_10.42.42.5(pid=5980): stdout: | (launched: 2022-12-09_19:20:52.473522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:54.356237 run osmo-stp_10.42.42.5(pid=5980): stderr: | [0;m[38;5;43m20221209192052666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192052666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192052667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192052667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192052668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:54.514326 run patchelf(pid=5983): Terminating (SIGINT) 19:20:54.696398 run patchelf(pid=5983): Terminated: ok {rc=0} 19:20:54.827988 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5980): Process ended prematurely: osmo-stp_10.42.42.5(pid=5980) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5980)] [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:20:54.838365 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:20:54.867128 run osmo-hlr_10.42.42.2(pid=5977): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5977)] 19:20:54.918294 run osmo-hlr_10.42.42.2(pid=5977): stdout: | (launched: 2022-12-09_19:20:51.457619) 19:20:54.970168 run osmo-hlr_10.42.42.2(pid=5977): stderr: | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192051659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192051671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192051679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192051679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192051679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:55.022520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5970): Terminating (SIGTERM) 19:20:55.064420 run iperf3-srv_10.42.42.10(pid=5971): Terminating (SIGTERM) 19:20:55.106446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5972): Terminating (SIGTERM) 19:20:55.147860 run iperf3-srv_10.42.42.10(pid=5973): Terminating (SIGTERM) 19:20:55.190208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5976): Terminating (SIGTERM) 19:20:55.232160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5979): Terminating (SIGTERM) 19:20:55.273883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5982): Terminating (SIGTERM) 19:20:55.315963 --- ParallelTerminationStrategy: PID 5970 died... 19:20:55.335798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5970): Terminated: ok {rc=0} 19:20:55.382519 --- ParallelTerminationStrategy: PID 5971 died... 19:20:55.401757 run iperf3-srv_10.42.42.10(pid=5971): Terminated {rc=256} 19:20:55.448051 --- ParallelTerminationStrategy: PID 5972 died... 19:20:55.467410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5972): Terminated: ok {rc=0} 19:20:55.513498 --- ParallelTerminationStrategy: PID 5973 died... 19:20:55.532685 run iperf3-srv_10.42.42.10(pid=5973): Terminated {rc=256} 19:20:55.578872 --- ParallelTerminationStrategy: PID 5976 died... 19:20:55.598725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5976): Terminated: ok {rc=0} 19:20:55.645065 --- ParallelTerminationStrategy: PID 5979 died... 19:20:55.664489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5979): Terminated: ok {rc=0} 19:20:55.710499 --- ParallelTerminationStrategy: PID 5982 died... 19:20:55.729891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5982): Terminated: ok {rc=0} 19:20:55.817625 bus /gobi_0: Setting Powered False 19:20:56.916682 bus /gobi_0: Setting Powered False 19:20:58.033096 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:20:59.179351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.191195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:20:59.248368 tst iperf3.py: using LAC 23167 19:20:59.367670 tst iperf3.py: using RAC 217 19:20:59.485492 tst iperf3.py: using CellId 23167 19:20:59.608507 tst iperf3.py: using BVCI 23168 19:20:59.720661 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.731951 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.742950 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.753968 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.764840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.775765 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.786827 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.797659 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:20:59.808820 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:20:59.922457 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:21:00.127382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:00.433415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Launched 19:21:00.698021 run iperf3-srv_10.42.42.10(pid=5985): Launched 19:21:00.813655 tst iperf3.py:8: start network... 19:21:01.021249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:01.500734 run create_hlr_db(pid=5986): Launched 19:21:01.660624 bus /gobi_6: Setting Powered False 19:21:02.720902 run create_hlr_db(pid=5986): Terminated: ok {rc=0} 19:21:03.165569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5988): Launched 19:21:03.490315 run osmo-hlr_10.42.42.2(pid=5989): Launched 19:21:03.617736 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:04.181672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5991): Launched 19:21:04.507061 run osmo-stp_10.42.42.5(pid=5992): Launched 19:21:04.633108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:05.193985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5994): Launched 19:21:05.319789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:05.594103 run patchelf(pid=5995): Launched 19:21:05.775454 run osmo-stp_10.42.42.5(pid=5992): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5992)] 19:21:05.912872 run osmo-stp_10.42.42.5(pid=5992): stdout: | (launched: 2022-12-09_19:21:04.447520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:06.052152 run osmo-stp_10.42.42.5(pid=5992): stderr: | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192104642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:06.191018 run osmo-stp_10.42.42.5(pid=5992): stdout: | (launched: 2022-12-09_19:21:04.447520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:06.324252 run osmo-stp_10.42.42.5(pid=5992): stderr: | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192104642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192104642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192104643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:06.482310 run patchelf(pid=5995): Terminating (SIGINT) 19:21:06.663934 run patchelf(pid=5995): Terminated: ok {rc=0} 19:21:06.795313 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5992): Process ended prematurely: osmo-stp_10.42.42.5(pid=5992) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5992)] [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:21:06.805701 tst iperf3.py:8: Test FAILED (7.7 sec) 19:21:06.834875 run osmo-hlr_10.42.42.2(pid=5989): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5989)] 19:21:06.884891 run osmo-hlr_10.42.42.2(pid=5989): stdout: | (launched: 2022-12-09_19:21:03.430917) 19:21:06.936873 run osmo-hlr_10.42.42.2(pid=5989): stderr: | [0;m[1;31m20221209192103631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192103631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192103631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192103631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192103631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192103632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192103644 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192103652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192103652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192103653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:06.989146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Terminating (SIGTERM) 19:21:07.031027 run iperf3-srv_10.42.42.10(pid=5985): Terminating (SIGTERM) 19:21:07.072481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5988): Terminating (SIGTERM) 19:21:07.114359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5991): Terminating (SIGTERM) 19:21:07.156218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5994): Terminating (SIGTERM) 19:21:07.198552 --- ParallelTerminationStrategy: PID 5984 died... 19:21:07.218480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Terminated: ok {rc=0} 19:21:07.265242 --- ParallelTerminationStrategy: PID 5985 died... 19:21:07.284586 run iperf3-srv_10.42.42.10(pid=5985): Terminated {rc=256} 19:21:07.330841 --- ParallelTerminationStrategy: PID 5988 died... 19:21:07.350272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5988): Terminated: ok {rc=0} 19:21:07.396403 --- ParallelTerminationStrategy: PID 5991 died... 19:21:07.415937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5991): Terminated: ok {rc=0} 19:21:07.462068 --- ParallelTerminationStrategy: PID 5994 died... 19:21:07.481547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5994): Terminated: ok {rc=0} 19:21:07.569613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:21:08.718485 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:08.731172 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:21:08.785365 tst iperf3m4.py: using LAC 23168 19:21:08.913090 tst iperf3m4.py: using RAC 218 19:21:09.041371 tst iperf3m4.py: using CellId 23168 19:21:09.168348 tst iperf3m4.py: using BVCI 23169 19:21:09.287472 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.299182 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.310782 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.322687 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.335368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.346811 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.358676 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.370555 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:09.382622 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:09.503534 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:09.624295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:09.744024 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:09.861602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:21:10.067241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:10.372824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5996): Launched 19:21:10.637354 run iperf3-srv_10.42.42.10(pid=5997): Launched 19:21:10.750669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:21:10.954460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:11.259671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5998): Launched 19:21:11.523723 run iperf3-srv_10.42.42.10(pid=5999): Launched 19:21:11.637439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:21:11.840750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:12.147088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6000): Launched 19:21:12.411206 run iperf3-srv_10.42.42.10(pid=6001): Launched 19:21:12.526298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:21:12.729178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:13.034998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6002): Launched 19:21:13.298931 run iperf3-srv_10.42.42.10(pid=6003): Launched 19:21:13.413791 tst iperf3m4.py:8: start network... 19:21:13.617040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:14.088171 run create_hlr_db(pid=6004): Launched 19:21:14.213118 bus /gobi_6: Setting Powered False 19:21:15.273175 run create_hlr_db(pid=6004): Terminated: ok {rc=0} 19:21:15.717539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6006): Launched 19:21:16.056321 run osmo-hlr_10.42.42.2(pid=6007): Launched 19:21:16.256265 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:16.990440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6009): Launched 19:21:17.379561 run osmo-stp_10.42.42.5(pid=6010): Launched 19:21:17.509764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:18.070618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6012): Launched 19:21:18.195722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:18.470496 run patchelf(pid=6013): Launched 19:21:18.651604 run osmo-stp_10.42.42.5(pid=6010): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] 19:21:18.789192 run osmo-stp_10.42.42.5(pid=6010): stdout: | (launched: 2022-12-09_19:21:17.308650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:18.928463 run osmo-stp_10.42.42.5(pid=6010): stderr: | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192117521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:19.067930 run osmo-stp_10.42.42.5(pid=6010): stdout: | (launched: 2022-12-09_19:21:17.308650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:19.201100 run osmo-stp_10.42.42.5(pid=6010): stderr: | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192117520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192117521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192117521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:19.359136 run patchelf(pid=6013): Terminating (SIGINT) 19:21:19.540354 run patchelf(pid=6013): Terminated: ok {rc=0} 19:21:19.671433 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6010): Process ended prematurely: osmo-stp_10.42.42.5(pid=6010) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:21:19.681762 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:21:19.711083 run osmo-hlr_10.42.42.2(pid=6007): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6007)] 19:21:19.761411 run osmo-hlr_10.42.42.2(pid=6007): stdout: | (launched: 2022-12-09_19:21:15.995032) 19:21:19.813194 run osmo-hlr_10.42.42.2(pid=6007): stderr: | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192116360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192116381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192116402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192116402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192116402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:19.865280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5996): Terminating (SIGTERM) 19:21:19.906814 run iperf3-srv_10.42.42.10(pid=5997): Terminating (SIGTERM) 19:21:19.948789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5998): Terminating (SIGTERM) 19:21:19.991253 run iperf3-srv_10.42.42.10(pid=5999): Terminating (SIGTERM) 19:21:20.032913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6000): Terminating (SIGTERM) 19:21:20.075023 run iperf3-srv_10.42.42.10(pid=6001): Terminating (SIGTERM) 19:21:20.117357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6002): Terminating (SIGTERM) 19:21:20.159477 run iperf3-srv_10.42.42.10(pid=6003): Terminating (SIGTERM) 19:21:20.201349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6006): Terminating (SIGTERM) 19:21:20.243177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6009): Terminating (SIGTERM) 19:21:20.285132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6012): Terminating (SIGTERM) 19:21:20.327169 --- ParallelTerminationStrategy: PID 5996 died... 19:21:20.346701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5996): Terminated: ok {rc=0} 19:21:20.393219 --- ParallelTerminationStrategy: PID 5997 died... 19:21:20.412582 run iperf3-srv_10.42.42.10(pid=5997): Terminated {rc=256} 19:21:20.458650 --- ParallelTerminationStrategy: PID 5998 died... 19:21:20.478025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5998): Terminated: ok {rc=0} 19:21:20.524130 --- ParallelTerminationStrategy: PID 5999 died... 19:21:20.543474 run iperf3-srv_10.42.42.10(pid=5999): Terminated {rc=256} 19:21:20.589449 --- ParallelTerminationStrategy: PID 6000 died... 19:21:20.608749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6000): Terminated: ok {rc=0} 19:21:20.654883 --- ParallelTerminationStrategy: PID 6001 died... 19:21:20.674240 run iperf3-srv_10.42.42.10(pid=6001): Terminated {rc=256} 19:21:20.720545 --- ParallelTerminationStrategy: PID 6002 died... 19:21:20.739999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6002): Terminated: ok {rc=0} 19:21:20.786219 --- ParallelTerminationStrategy: PID 6003 died... 19:21:20.805567 run iperf3-srv_10.42.42.10(pid=6003): Terminated {rc=256} 19:21:20.851667 --- ParallelTerminationStrategy: PID 6006 died... 19:21:20.871159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6006): Terminated: ok {rc=0} 19:21:20.917350 --- ParallelTerminationStrategy: PID 6009 died... 19:21:20.936784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6009): Terminated: ok {rc=0} 19:21:20.983321 --- ParallelTerminationStrategy: PID 6012 died... 19:21:21.002846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6012): Terminated: ok {rc=0} 19:21:21.090379 bus /gobi_4: Setting Powered False 19:21:22.186624 bus /gobi_4: Setting Powered False 19:21:23.300316 bus /gobi_1: Setting Powered False 19:21:24.400840 bus /gobi_1: Setting Powered False 19:21:25.516051 bus /gobi_0: Setting Powered False 19:21:26.613125 bus /gobi_0: Setting Powered False 19:21:27.729465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:21:28.827763 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:28.839512 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:21:28.891239 tst ping.py: using LAC 23169 19:21:29.010016 tst ping.py: using RAC 219 19:21:29.128712 tst ping.py: using CellId 23169 19:21:29.245080 tst ping.py: using BVCI 23170 19:21:29.363022 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.375077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.386859 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.400326 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.412079 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.425122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.436903 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:29.448094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:29.561723 tst ping.py:19: start network... 19:21:29.761581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:30.224834 run create_hlr_db(pid=6014): Launched 19:21:30.346509 bus /gobi_6: Setting Powered False 19:21:31.421196 run create_hlr_db(pid=6014): Terminated: ok {rc=0} 19:21:31.899594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6016): Launched 19:21:32.237107 run osmo-hlr_10.42.42.2(pid=6017): Launched 19:21:32.360336 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:32.915854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6019): Launched 19:21:33.237363 run osmo-stp_10.42.42.5(pid=6020): Launched 19:21:33.360383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:33.913903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6022): Launched 19:21:34.037449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:34.307900 run patchelf(pid=6023): Launched 19:21:34.485774 run osmo-stp_10.42.42.5(pid=6020): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6020)] 19:21:34.621217 run osmo-stp_10.42.42.5(pid=6020): stdout: | (launched: 2022-12-09_19:21:33.178598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:34.758207 run osmo-stp_10.42.42.5(pid=6020): stderr: | [0;m[38;5;43m20221209192133370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192133370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192133371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192133371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192133372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192133372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192133373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:34.895540 run osmo-stp_10.42.42.5(pid=6020): stdout: | (launched: 2022-12-09_19:21:33.178598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:35.027604 run osmo-stp_10.42.42.5(pid=6020): stderr: | [0;m[38;5;43m20221209192133370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192133370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192133371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192133371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192133372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192133372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192133373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:35.183614 run patchelf(pid=6023): Terminating (SIGINT) 19:21:35.362061 run patchelf(pid=6023): Terminated: ok {rc=0} 19:21:35.490862 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6020): Process ended prematurely: osmo-stp_10.42.42.5(pid=6020) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6020)] [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:21:35.500591 tst ping.py:22: Test FAILED (6.7 sec) 19:21:35.528728 run osmo-hlr_10.42.42.2(pid=6017): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6017)] 19:21:35.578930 run osmo-hlr_10.42.42.2(pid=6017): stdout: | (launched: 2022-12-09_19:21:32.177957) 19:21:35.630786 run osmo-hlr_10.42.42.2(pid=6017): stderr: | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192132377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192132390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192132398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192132398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192132399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:35.682975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6016): Terminating (SIGTERM) 19:21:35.724611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6019): Terminating (SIGTERM) 19:21:35.766401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6022): Terminating (SIGTERM) 19:21:35.808380 --- ParallelTerminationStrategy: PID 6016 died... 19:21:35.828212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6016): Terminated: ok {rc=0} 19:21:35.874977 --- ParallelTerminationStrategy: PID 6019 died... 19:21:35.894988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6019): Terminated: ok {rc=0} 19:21:35.941812 --- ParallelTerminationStrategy: PID 6022 died... 19:21:35.961311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6022): Terminated: ok {rc=0} 19:21:36.049592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:21:37.136141 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.148166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:21:37.202515 tst ping_idle_ping.py: using LAC 23170 19:21:37.321332 tst ping_idle_ping.py: using RAC 220 19:21:37.440346 tst ping_idle_ping.py: using CellId 23170 19:21:37.560705 tst ping_idle_ping.py: using BVCI 23171 19:21:37.679507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.691499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.703247 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.715368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.727237 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.739217 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.751096 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:21:37.762958 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:21:37.882935 tst ping_idle_ping.py:24: start network... 19:21:38.085542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:38.554032 run create_hlr_db(pid=6024): Launched 19:21:38.679735 bus /gobi_6: Setting Powered False 19:21:39.740592 run create_hlr_db(pid=6024): Terminated: ok {rc=0} 19:21:40.180438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6026): Launched 19:21:40.503423 run osmo-hlr_10.42.42.2(pid=6027): Launched 19:21:40.626922 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:41.180688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6029): Launched 19:21:41.500915 run osmo-stp_10.42.42.5(pid=6030): Launched 19:21:41.625330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:42.179310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6032): Launched 19:21:42.301520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:42.571675 run patchelf(pid=6033): Launched 19:21:42.750609 run osmo-stp_10.42.42.5(pid=6030): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6030)] 19:21:42.886151 run osmo-stp_10.42.42.5(pid=6030): stdout: | (launched: 2022-12-09_19:21:41.442008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:43.023522 run osmo-stp_10.42.42.5(pid=6030): stderr: | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192141638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:43.161383 run osmo-stp_10.42.42.5(pid=6030): stdout: | (launched: 2022-12-09_19:21:41.442008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:43.292731 run osmo-stp_10.42.42.5(pid=6030): stderr: | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192141637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192141638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192141638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:43.448836 run patchelf(pid=6033): Terminating (SIGINT) 19:21:43.627628 run patchelf(pid=6033): Terminated: ok {rc=0} 19:21:43.756865 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6030): Process ended prematurely: osmo-stp_10.42.42.5(pid=6030) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6030)] [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:21:43.766991 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:21:43.795658 run osmo-hlr_10.42.42.2(pid=6027): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6027)] 19:21:43.845603 run osmo-hlr_10.42.42.2(pid=6027): stdout: | (launched: 2022-12-09_19:21:40.444152) 19:21:43.897262 run osmo-hlr_10.42.42.2(pid=6027): stderr: | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192140642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192140657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192140665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192140665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192140665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:43.949618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6026): Terminating (SIGTERM) 19:21:43.991417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6029): Terminating (SIGTERM) 19:21:44.032729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6032): Terminating (SIGTERM) 19:21:44.075270 --- ParallelTerminationStrategy: PID 6026 died... 19:21:44.095343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6026): Terminated: ok {rc=0} 19:21:44.142042 --- ParallelTerminationStrategy: PID 6029 died... 19:21:44.161733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6029): Terminated: ok {rc=0} 19:21:44.208400 --- ParallelTerminationStrategy: PID 6032 died... 19:21:44.228155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6032): Terminated: ok {rc=0} 19:21:44.317837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:21:45.629618 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:21:45.636913 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:21:45.671247 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:21:45.706895 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:21:45.762910 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:21:45.796879 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:21:45.833745 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:21:46.399031 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:21:46.410573 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:46.428528 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:21:46.512547 tst switch_tch_pdch.py: using LAC 23171 19:21:46.637043 tst switch_tch_pdch.py: using RAC 221 19:21:46.777489 tst switch_tch_pdch.py: using CellId 23171 19:21:46.897120 tst switch_tch_pdch.py: using BVCI 23172 19:21:47.064542 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.081326 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.097789 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.112005 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.124841 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.137685 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.150272 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:21:47.163358 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:47.282183 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:47.400754 tst switch_tch_pdch.py:51: start network... 19:21:47.617779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:48.114928 run create_hlr_db(pid=6037): Launched 19:21:48.237292 bus /gobi_6: Setting Powered False 19:21:49.300311 run create_hlr_db(pid=6037): Terminated: ok {rc=0} 19:21:49.743030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Launched 19:21:50.065663 run osmo-hlr_10.42.42.2(pid=6040): Launched 19:21:50.187582 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:50.739343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Launched 19:21:51.059891 run osmo-stp_10.42.42.5(pid=6043): Launched 19:21:51.182483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:51.735178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Launched 19:21:51.858508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:52.128633 run patchelf(pid=6047): Launched 19:21:52.305292 run osmo-stp_10.42.42.5(pid=6043): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] 19:21:52.440668 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-09_19:21:51.001577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:52.577585 run osmo-stp_10.42.42.5(pid=6043): stderr: | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192151193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:52.714000 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-09_19:21:51.001577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:52.844881 run osmo-stp_10.42.42.5(pid=6043): stderr: | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192151192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192151193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192151193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:53.000328 run patchelf(pid=6047): Terminating (SIGINT) 19:21:53.177804 run patchelf(pid=6047): Terminated: ok {rc=0} 19:21:53.305884 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:21:53.315549 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:21:53.344090 run osmo-hlr_10.42.42.2(pid=6040): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6040)] 19:21:53.394023 run osmo-hlr_10.42.42.2(pid=6040): stdout: | (launched: 2022-12-09_19:21:50.006459) 19:21:53.445528 run osmo-hlr_10.42.42.2(pid=6040): stderr: | [0;m[1;31m20221209192150203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192150203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192150203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192150203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192150203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192150204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192150215 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192150224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192150224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192150224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:53.497580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminating (SIGTERM) 19:21:53.539135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminating (SIGTERM) 19:21:53.580627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminating (SIGTERM) 19:21:53.622498 --- ParallelTerminationStrategy: PID 6039 died... 19:21:53.642235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminated: ok {rc=0} 19:21:53.688563 --- ParallelTerminationStrategy: PID 6042 died... 19:21:53.707982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminated: ok {rc=0} 19:21:53.754136 --- ParallelTerminationStrategy: PID 6045 died... 19:21:53.773653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminated: ok {rc=0} 19:21:53.861826 bus /gobi_0: Setting Powered False 19:21:54.958696 bus /gobi_0: Setting Powered False 19:21:56.069485 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:21:57.322756 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:21:57.329091 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:21:57.363413 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:21:57.398538 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:21:57.452504 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:21:57.485836 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:21:57.521032 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:21:58.076931 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:21:58.082515 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.094112 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:21:58.164312 tst switch_tch_pdch.py: using LAC 23172 19:21:58.288580 tst switch_tch_pdch.py: using RAC 222 19:21:58.412717 tst switch_tch_pdch.py: using CellId 23172 19:21:58.538688 tst switch_tch_pdch.py: using BVCI 23173 19:21:58.656188 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.667598 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.678939 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.690349 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.701803 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.713197 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.725503 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:21:58.736913 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:21:58.856801 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:21:58.977136 tst switch_tch_pdch.py:51: start network... 19:21:59.192437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:59.658306 run create_hlr_db(pid=6051): Launched 19:21:59.780676 bus /gobi_6: Setting Powered False 19:22:00.865235 run create_hlr_db(pid=6051): Terminated: ok {rc=0} 19:22:01.311323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6053): Launched 19:22:01.645486 run osmo-hlr_10.42.42.2(pid=6054): Launched 19:22:01.791727 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:02.454346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6056): Launched 19:22:02.753170 run osmo-stp_10.42.42.5(pid=6057): Launched 19:22:02.866841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:03.356650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6059): Launched 19:22:03.470391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:03.722427 run patchelf(pid=6060): Launched 19:22:03.887741 run osmo-stp_10.42.42.5(pid=6057): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6057)] 19:22:04.014346 run osmo-stp_10.42.42.5(pid=6057): stdout: | (launched: 2022-12-09_19:22:02.698018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:04.142286 run osmo-stp_10.42.42.5(pid=6057): stderr: | [0;m[38;5;43m20221209192202868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192202868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192202869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192202869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:04.270520 run osmo-stp_10.42.42.5(pid=6057): stdout: | (launched: 2022-12-09_19:22:02.698018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:04.392711 run osmo-stp_10.42.42.5(pid=6057): stderr: | [0;m[38;5;43m20221209192202868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192202868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192202869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192202869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192202870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:04.539174 run patchelf(pid=6060): Terminating (SIGINT) 19:22:04.706039 run patchelf(pid=6060): Terminated: ok {rc=0} 19:22:04.826414 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6057): Process ended prematurely: osmo-stp_10.42.42.5(pid=6057) [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6057)] [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:22:04.835698 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 19:22:04.861953 run osmo-hlr_10.42.42.2(pid=6054): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6054)] 19:22:04.909055 run osmo-hlr_10.42.42.2(pid=6054): stdout: | (launched: 2022-12-09_19:22:01.586377) 19:22:04.957624 run osmo-hlr_10.42.42.2(pid=6054): stderr: | [0;m[1;31m20221209192201964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192201964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192201964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192201964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192201964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192201965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192201988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192202000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192202000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192202000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:05.006566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6053): Terminating (SIGTERM) 19:22:05.046578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6056): Terminating (SIGTERM) 19:22:05.085964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6059): Terminating (SIGTERM) 19:22:05.125597 --- ParallelTerminationStrategy: PID 6053 died... 19:22:05.144332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6053): Terminated: ok {rc=0} 19:22:05.188069 --- ParallelTerminationStrategy: PID 6056 died... 19:22:05.206507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6056): Terminated: ok {rc=0} 19:22:05.249911 --- ParallelTerminationStrategy: PID 6059 died... 19:22:05.268240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6059): Terminated: ok {rc=0} 19:22:05.351390 bus /gobi_0: Setting Powered False 19:22:06.445981 bus /gobi_0: Setting Powered False 19:22:07.560067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:trx-lms --------------------------------------------------------------------- 19:22:08.810168 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:08.814618 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:22:08.848826 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:22:08.855783 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:22:08.908744 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:22:08.942544 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:22:08.949863 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:22:09.488282 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:22:09.493544 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 19:22:09.504378 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 19:22:09.552886 tst mo_mt_sms.py: using LAC 23173 19:22:09.677802 tst mo_mt_sms.py: using RAC 223 19:22:09.802716 tst mo_mt_sms.py: using CellId 23173 19:22:09.928861 tst mo_mt_sms.py: using BVCI 23174 19:22:10.044905 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:22:10.161984 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:22:10.275521 tst mo_mt_sms.py:9: start nitb and bts... 19:22:10.478999 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:22:11.089684 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6066): Launched 19:22:11.388785 run osmo-nitb_10.42.42.2(pid=6067): Launched 19:22:11.553432 run osmo-nitb_10.42.42.2(pid=6067): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6067)] 19:22:11.686972 run osmo-nitb_10.42.42.2(pid=6067): stdout: | (launched: 2022-12-09_19:22:11.332785) 19:22:11.821793 run osmo-nitb_10.42.42.2(pid=6067): stderr: | (launched: 2022-12-09_19:22:11.378084) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:22:11.956841 run osmo-nitb_10.42.42.2(pid=6067): stdout: | (launched: 2022-12-09_19:22:11.332785) 19:22:12.086201 run osmo-nitb_10.42.42.2(pid=6067): stderr: | (launched: 2022-12-09_19:22:11.378084) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6067) [trial-2363↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6067)] 19:22:12.500464 tst osmo-nitb_10.42.42.2(pid=6067): stdout: | (launched: 2022-12-09_19:22:11.332785) 19:22:12.621441 tst osmo-nitb_10.42.42.2(pid=6067): stderr: | (launched: 2022-12-09_19:22:11.378084) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:22:12.763128 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6067) [trial-2363↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6067)] [trial-2363↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 19:22:12.771591 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:22:12.778138 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6066): Terminating (SIGTERM) 19:22:12.985561 --- ParallelTerminationStrategy: PID 6066 died... 19:22:13.006254 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6066): Terminated: ok {rc=0} 19:22:13.088453 bus /sierra_3: Setting Powered False 19:22:14.186254 bus /sierra_3: Setting Powered False 19:22:15.302168 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:trx-lms --------------------------------------------------------------------- 19:22:16.501543 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:16.505809 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:22:16.544005 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:22:16.574648 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:22:16.628934 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:22:16.675371 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:22:16.712788 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:22:17.258516 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:22:17.264521 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.275912 tst sms:trx-lms: Using 1 x bts (candidates: 1) 19:22:17.328827 tst mo_mt_sms.py: using LAC 23174 19:22:17.455094 tst mo_mt_sms.py: using RAC 224 19:22:17.581365 tst mo_mt_sms.py: using CellId 23174 19:22:17.707389 tst mo_mt_sms.py: using BVCI 23175 19:22:17.824572 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.835477 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.846307 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.857452 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.868414 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:17.879334 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:22:17.994383 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:22:18.116503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:18.611496 run create_hlr_db(pid=6071): Launched 19:22:18.732777 bus /sierra_2: Setting Powered False 19:22:19.796193 run create_hlr_db(pid=6071): Terminated: ok {rc=0} 19:22:20.241174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Launched 19:22:20.560331 run osmo-hlr_10.42.42.2(pid=6074): Launched 19:22:20.683581 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:21.235318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Launched 19:22:21.555026 run osmo-stp_10.42.42.5(pid=6077): Launched 19:22:21.680542 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:22.259519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Launched 19:22:22.581747 run osmo-msc_10.42.42.6(pid=6080): Launched 19:22:22.760202 run osmo-stp_10.42.42.5(pid=6077): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] 19:22:22.895451 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-09_19:22:21.496606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:23.031576 run osmo-stp_10.42.42.5(pid=6077): stderr: | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192221690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:23.165918 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-09_19:22:21.496606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:23.293560 run osmo-stp_10.42.42.5(pid=6077): stderr: | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192221689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192221690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192221690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:23.445792 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2363↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] [trial-2363↪sms:trx-lms↪mo_mt_sms.py:16] 19:22:23.454802 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 19:22:23.482114 run osmo-hlr_10.42.42.2(pid=6074): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6074)] 19:22:23.532144 run osmo-hlr_10.42.42.2(pid=6074): stdout: | (launched: 2022-12-09_19:22:20.501596) 19:22:23.583260 run osmo-hlr_10.42.42.2(pid=6074): stderr: | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192220703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192220718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:23.654533 run osmo-msc_10.42.42.6(pid=6080): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6080)] 19:22:23.704160 run osmo-msc_10.42.42.6(pid=6080): stdout: | (launched: 2022-12-09_19:22:22.521952) 19:22:23.755314 run osmo-msc_10.42.42.6(pid=6080): stderr: | [0;m[38;5;43m20221209192222845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192222845 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f74028eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192222846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192222846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192222846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192222846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192222848 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192222848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192222848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192222848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:23.806910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminating (SIGTERM) 19:22:23.848485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminating (SIGTERM) 19:22:23.889887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Terminating (SIGTERM) 19:22:23.931324 --- ParallelTerminationStrategy: PID 6073 died... 19:22:23.950992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminated: ok {rc=0} 19:22:23.997401 --- ParallelTerminationStrategy: PID 6076 died... 19:22:24.016678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminated: ok {rc=0} 19:22:24.062482 --- ParallelTerminationStrategy: PID 6079 died... 19:22:24.081707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Terminated: ok {rc=0} 19:22:24.168305 bus /sierra_3: Setting Powered False 19:22:25.266334 bus /sierra_3: Setting Powered False 19:22:26.381868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-lms --------------------------------------------------------------------- 19:22:27.611475 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:27.615552 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:22:27.649520 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:22:27.656770 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:22:27.691176 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:22:27.725453 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:22:27.732299 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:22:28.253122 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 19:22:28.258559 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 19:22:28.269879 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 19:22:28.318494 tst assert_extension.py: using LAC 23175 19:22:28.441863 tst assert_extension.py: using RAC 225 19:22:28.567353 tst assert_extension.py: using CellId 23175 19:22:28.690442 tst assert_extension.py: using BVCI 23176 19:22:28.807335 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 19:22:28.920528 tst assert_extension.py:10: start nitb and bts... 19:22:29.122281 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:22:29.734625 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6086): Launched 19:22:30.035329 run osmo-nitb_10.42.42.2(pid=6087): Launched 19:22:30.200527 run osmo-nitb_10.42.42.2(pid=6087): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6087)] 19:22:30.334526 run osmo-nitb_10.42.42.2(pid=6087): stdout: | (launched: 2022-12-09_19:22:29.980043) 19:22:30.469919 run osmo-nitb_10.42.42.2(pid=6087): stderr: | (launched: 2022-12-09_19:22:30.024574) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:22:30.605509 run osmo-nitb_10.42.42.2(pid=6087): stdout: | (launched: 2022-12-09_19:22:29.980043) 19:22:30.736045 run osmo-nitb_10.42.42.2(pid=6087): stderr: | (launched: 2022-12-09_19:22:30.024574) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6087): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6087) [trial-2363↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6087)] 19:22:31.147908 tst osmo-nitb_10.42.42.2(pid=6087): stdout: | (launched: 2022-12-09_19:22:29.980043) 19:22:31.303247 tst osmo-nitb_10.42.42.2(pid=6087): stderr: | (launched: 2022-12-09_19:22:30.024574) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:22:31.465399 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6087): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6087) [trial-2363↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6087)] [trial-2363↪nitb_ussd:trx-lms↪assert_extension.py:12] 19:22:31.475505 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:22:31.483640 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6086): Terminating (SIGTERM) 19:22:31.697537 --- ParallelTerminationStrategy: PID 6086 died... 19:22:31.721702 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6086): Terminated: ok {rc=0} 19:22:31.837570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:trx-lms --------------------------------------------------------------------- 19:22:33.026797 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:33.031040 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:22:33.065507 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:22:33.092807 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:22:33.127601 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:22:33.161693 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:22:33.188929 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:22:33.717294 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:trx-lms assert_extension.py ---------------------------------------------- 19:22:33.722642 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:33.733846 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 19:22:33.783258 tst assert_extension.py: using LAC 23176 19:22:33.908016 tst assert_extension.py: using RAC 226 19:22:34.034841 tst assert_extension.py: using CellId 23176 19:22:34.160120 tst assert_extension.py: using BVCI 23177 19:22:34.275358 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:34.286369 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:34.297250 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:34.308311 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:34.319538 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:22:34.330811 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 19:22:34.446369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:34.942511 run create_hlr_db(pid=6091): Launched 19:22:35.066731 bus /sierra_2: Setting Powered False 19:22:36.129740 run create_hlr_db(pid=6091): Terminated: ok {rc=0} 19:22:36.575531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6093): Launched 19:22:36.897471 run osmo-hlr_10.42.42.2(pid=6095): Launched 19:22:37.020847 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:37.576009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6097): Launched 19:22:37.895912 run osmo-stp_10.42.42.5(pid=6098): Launched 19:22:38.018692 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:38.597113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6100): Launched 19:22:38.917875 run osmo-msc_10.42.42.6(pid=6101): Launched 19:22:39.097094 run osmo-stp_10.42.42.5(pid=6098): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6098)] 19:22:39.232463 run osmo-stp_10.42.42.5(pid=6098): stdout: | (launched: 2022-12-09_19:22:37.837209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:39.368291 run osmo-stp_10.42.42.5(pid=6098): stderr: | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192238031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:39.503443 run osmo-stp_10.42.42.5(pid=6098): stdout: | (launched: 2022-12-09_19:22:37.837209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:39.631425 run osmo-stp_10.42.42.5(pid=6098): stderr: | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192238030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192238031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192238031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:39.784675 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6098): Process ended prematurely: osmo-stp_10.42.42.5(pid=6098) [trial-2363↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6098)] [trial-2363↪ussd:trx-lms↪assert_extension.py:17] 19:22:39.794045 tst assert_extension.py:17: Test FAILED (6.1 sec) 19:22:39.821845 run osmo-hlr_10.42.42.2(pid=6095): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6095)] 19:22:39.871588 run osmo-hlr_10.42.42.2(pid=6095): stdout: | (launched: 2022-12-09_19:22:36.838198) 19:22:39.922805 run osmo-hlr_10.42.42.2(pid=6095): stderr: | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192237038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192237048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192237056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192237057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192237057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:39.994654 run osmo-msc_10.42.42.6(pid=6101): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6101)] 19:22:40.044467 run osmo-msc_10.42.42.6(pid=6101): stdout: | (launched: 2022-12-09_19:22:38.858857) 19:22:40.095793 run osmo-msc_10.42.42.6(pid=6101): stderr: | [0;m[38;5;43m20221209192239183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192239184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90f9db1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192239184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192239184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192239184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192239184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192239186 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192239186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192239186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192239186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:40.147480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6093): Terminating (SIGTERM) 19:22:40.188734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6097): Terminating (SIGTERM) 19:22:40.230542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6100): Terminating (SIGTERM) 19:22:40.272361 --- ParallelTerminationStrategy: PID 6093 died... 19:22:40.292382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6093): Terminated: ok {rc=0} 19:22:40.339451 --- ParallelTerminationStrategy: PID 6097 died... 19:22:40.358935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6097): Terminated: ok {rc=0} 19:22:40.405317 --- ParallelTerminationStrategy: PID 6100 died... 19:22:40.424564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6100): Terminated: ok {rc=0} 19:22:40.512355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:22:41.723526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:41.731398 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:22:41.766574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:22:41.794041 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:22:41.853007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:22:41.887409 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:22:41.914632 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:22:42.458989 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:22:42.512413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:42.523924 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:22:42.593534 tst mo_mt_call.py: using LAC 23177 19:22:42.721214 tst mo_mt_call.py: using RAC 227 19:22:42.846800 tst mo_mt_call.py: using CellId 23177 19:22:42.977916 tst mo_mt_call.py: using BVCI 23178 19:22:43.097965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:43.109475 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:43.120702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:43.132360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:43.144273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:43.156028 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:22:43.273335 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:22:43.389152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:43.895038 run create_hlr_db(pid=6106): Launched 19:22:44.020538 bus /sierra_2: Setting Powered False 19:22:45.084860 run create_hlr_db(pid=6106): Terminated: ok {rc=0} 19:22:45.521301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6108): Launched 19:22:45.832665 run osmo-hlr_10.42.42.2(pid=6109): Launched 19:22:46.110552 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:46.752147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6111): Launched 19:22:47.077321 run osmo-stp_10.42.42.5(pid=6112): Launched 19:22:47.325124 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:47.930407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6114): Launched 19:22:48.258657 run osmo-msc_10.42.42.6(pid=6115): Launched 19:22:48.441964 run osmo-stp_10.42.42.5(pid=6112): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6112)] 19:22:48.579176 run osmo-stp_10.42.42.5(pid=6112): stdout: | (launched: 2022-12-09_19:22:47.019686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:48.716894 run osmo-stp_10.42.42.5(pid=6112): stderr: | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192247294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:48.854023 run osmo-stp_10.42.42.5(pid=6112): stdout: | (launched: 2022-12-09_19:22:47.019686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:48.984393 run osmo-stp_10.42.42.5(pid=6112): stderr: | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192247293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192247294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192247294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:49.140327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6112): Process ended prematurely: osmo-stp_10.42.42.5(pid=6112) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6112)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:22:49.150045 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:22:49.178190 run osmo-hlr_10.42.42.2(pid=6109): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6109)] 19:22:49.228334 run osmo-hlr_10.42.42.2(pid=6109): stdout: | (launched: 2022-12-09_19:22:45.770095) 19:22:49.280047 run osmo-hlr_10.42.42.2(pid=6109): stderr: | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192246058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192246076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192246092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192246093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192246093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:49.352259 run osmo-msc_10.42.42.6(pid=6115): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6115)] 19:22:49.402410 run osmo-msc_10.42.42.6(pid=6115): stdout: | (launched: 2022-12-09_19:22:48.199085) 19:22:49.453824 run osmo-msc_10.42.42.6(pid=6115): stderr: | [0;m[38;5;43m20221209192248523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192248523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f27e949cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192248523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192248523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192248523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192248523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192248525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192248525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192248526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192248526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:49.505796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6108): Terminating (SIGTERM) 19:22:49.547719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6111): Terminating (SIGTERM) 19:22:49.590149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6114): Terminating (SIGTERM) 19:22:49.632276 --- ParallelTerminationStrategy: PID 6108 died... 19:22:49.652201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6108): Terminated: ok {rc=0} 19:22:49.698867 --- ParallelTerminationStrategy: PID 6111 died... 19:22:49.718291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6111): Terminated: ok {rc=0} 19:22:49.764558 --- ParallelTerminationStrategy: PID 6114 died... 19:22:49.784087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6114): Terminated: ok {rc=0} 19:22:49.872179 bus /sierra_3: Setting Powered False 19:22:50.970930 bus /sierra_3: Setting Powered False 19:22:52.087396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:22:53.237302 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.249449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:22:53.321501 tst mo_mt_call_osmux.py: using LAC 23178 19:22:53.444132 tst mo_mt_call_osmux.py: using RAC 228 19:22:53.565462 tst mo_mt_call_osmux.py: using CellId 23178 19:22:53.685277 tst mo_mt_call_osmux.py: using BVCI 23179 19:22:53.795545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.806834 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.817843 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.829044 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.840575 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:22:53.851702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:22:53.966002 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:22:54.088086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:54.593715 run create_hlr_db(pid=6117): Launched 19:22:54.719858 bus /sierra_2: Setting Powered False 19:22:55.783767 run create_hlr_db(pid=6117): Terminated: ok {rc=0} 19:22:56.219447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Launched 19:22:56.523852 run osmo-hlr_10.42.42.2(pid=6120): Launched 19:22:56.641484 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:57.172817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Launched 19:22:57.477885 run osmo-stp_10.42.42.5(pid=6123): Launched 19:22:57.595254 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:58.149304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6125): Launched 19:22:58.454730 run osmo-msc_10.42.42.6(pid=6126): Launched 19:22:58.625606 run osmo-stp_10.42.42.5(pid=6123): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] 19:22:58.753876 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-09_19:22:57.421525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:58.883309 run osmo-stp_10.42.42.5(pid=6123): stderr: | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192257594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:59.010455 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-09_19:22:57.421525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:59.131788 run osmo-stp_10.42.42.5(pid=6123): stderr: | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192257594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:59.276803 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:22:59.286166 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:22:59.312316 run osmo-hlr_10.42.42.2(pid=6120): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6120)] 19:22:59.359472 run osmo-hlr_10.42.42.2(pid=6120): stdout: | (launched: 2022-12-09_19:22:56.468049) 19:22:59.408475 run osmo-hlr_10.42.42.2(pid=6120): stderr: | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192256647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192256659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192256669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192256669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192256669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:59.476646 run osmo-msc_10.42.42.6(pid=6126): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6126)] 19:22:59.523909 run osmo-msc_10.42.42.6(pid=6126): stdout: | (launched: 2022-12-09_19:22:58.398533) 19:22:59.573150 run osmo-msc_10.42.42.6(pid=6126): stderr: | [0;m[38;5;43m20221209192258671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192258672 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f111fd90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192258672 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192258672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192258672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192258672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192258674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192258674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192258674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192258674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:59.622057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminating (SIGTERM) 19:22:59.661388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminating (SIGTERM) 19:22:59.700817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6125): Terminating (SIGTERM) 19:22:59.740282 --- ParallelTerminationStrategy: PID 6119 died... 19:22:59.759179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminated: ok {rc=0} 19:22:59.802804 --- ParallelTerminationStrategy: PID 6122 died... 19:22:59.821350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminated: ok {rc=0} 19:22:59.864754 --- ParallelTerminationStrategy: PID 6125 died... 19:22:59.883136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6125): Terminated: ok {rc=0} 19:22:59.967556 bus /sierra_3: Setting Powered False 19:23:01.070806 bus /sierra_3: Setting Powered False 19:23:02.213821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:23:03.551283 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:03.560242 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:23:03.596930 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:23:03.634633 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:23:03.696937 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:23:03.743294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:23:03.789912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:23:04.310770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:23:04.367487 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:04.381210 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:23:04.455110 tst mo_mt_call.py: using LAC 23179 19:23:04.587769 tst mo_mt_call.py: using RAC 229 19:23:04.716419 tst mo_mt_call.py: using CellId 23179 19:23:04.848789 tst mo_mt_call.py: using BVCI 23180 19:23:04.969900 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:04.983509 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:04.996885 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:05.009176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:05.023843 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:05.037362 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:23:05.164184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:23:05.291734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:05.807640 run create_hlr_db(pid=6401): Launched 19:23:05.941186 bus /sierra_2: Setting Powered False 19:23:07.006753 run create_hlr_db(pid=6401): Terminated: ok {rc=0} 19:23:07.470845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6404): Launched 19:23:07.816610 run osmo-hlr_10.42.42.2(pid=6405): Launched 19:23:08.063898 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:08.736625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6407): Launched 19:23:09.082676 run osmo-stp_10.42.42.5(pid=6408): Launched 19:23:09.330195 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:10.016518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6410): Launched 19:23:10.362047 run osmo-msc_10.42.42.6(pid=6411): Launched 19:23:10.724805 run osmo-stp_10.42.42.5(pid=6408): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6408)] 19:23:11.018068 run osmo-stp_10.42.42.5(pid=6408): stdout: | (launched: 2022-12-09_19:23:09.022204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:11.189350 run osmo-stp_10.42.42.5(pid=6408): stderr: | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192309323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:11.328923 run osmo-stp_10.42.42.5(pid=6408): stdout: | (launched: 2022-12-09_19:23:09.022204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:11.464515 run osmo-stp_10.42.42.5(pid=6408): stderr: | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192309322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192309323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192309323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:11.626808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6408): Process ended prematurely: osmo-stp_10.42.42.5(pid=6408) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6408)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:23:11.638304 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 19:23:11.670560 run osmo-hlr_10.42.42.2(pid=6405): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6405)] 19:23:11.725494 run osmo-hlr_10.42.42.2(pid=6405): stdout: | (launched: 2022-12-09_19:23:07.755831) 19:23:11.781818 run osmo-hlr_10.42.42.2(pid=6405): stderr: | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192308060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192308078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192308086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192308086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192308086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:11.857202 run osmo-msc_10.42.42.6(pid=6411): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6411)] 19:23:11.910275 run osmo-msc_10.42.42.6(pid=6411): stdout: | (launched: 2022-12-09_19:23:10.300936) 19:23:11.964881 run osmo-msc_10.42.42.6(pid=6411): stderr: | [0;m[38;5;43m20221209192310808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192310808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83f7d69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192310808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192310808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192310808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192310808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192310810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192310811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192310811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192310811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:12.021176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6404): Terminating (SIGTERM) 19:23:12.066086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6407): Terminating (SIGTERM) 19:23:12.112909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6410): Terminating (SIGTERM) 19:23:12.159180 --- ParallelTerminationStrategy: PID 6404 died... 19:23:12.181141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6404): Terminated: ok {rc=0} 19:23:12.232439 --- ParallelTerminationStrategy: PID 6407 died... 19:23:12.253219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6407): Terminated: ok {rc=0} 19:23:12.302913 --- ParallelTerminationStrategy: PID 6410 died... 19:23:12.323479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6410): Terminated: ok {rc=0} 19:23:12.418112 bus /sierra_3: Setting Powered False 19:23:13.523244 bus /sierra_3: Setting Powered False 19:23:14.647653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:23:15.810208 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:15.826141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:23:15.944085 tst mo_mt_call_osmux.py: using LAC 23180 19:23:16.091287 tst mo_mt_call_osmux.py: using RAC 230 19:23:16.255496 tst mo_mt_call_osmux.py: using CellId 23180 19:23:16.451274 tst mo_mt_call_osmux.py: using BVCI 23181 19:23:16.585064 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:16.597613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:16.609996 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:16.623423 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:16.637841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:23:16.651279 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:23:16.790737 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:23:16.926296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:17.451777 run create_hlr_db(pid=6413): Launched 19:23:17.618114 bus /sierra_2: Setting Powered False 19:23:18.680038 run create_hlr_db(pid=6413): Terminated: ok {rc=0} 19:23:19.153404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Launched 19:23:19.496392 run osmo-hlr_10.42.42.2(pid=6416): Launched 19:23:19.747127 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:20.421727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Launched 19:23:20.765067 run osmo-stp_10.42.42.5(pid=6419): Launched 19:23:21.012725 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:21.686069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6421): Launched 19:23:22.029025 run osmo-msc_10.42.42.6(pid=6422): Launched 19:23:22.384466 run osmo-stp_10.42.42.5(pid=6419): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] 19:23:22.677499 run osmo-stp_10.42.42.5(pid=6419): stdout: | (launched: 2022-12-09_19:23:20.704563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:22.848396 run osmo-stp_10.42.42.5(pid=6419): stderr: | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192320999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:22.988187 run osmo-stp_10.42.42.5(pid=6419): stdout: | (launched: 2022-12-09_19:23:20.704563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:23.123162 run osmo-stp_10.42.42.5(pid=6419): stderr: | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192320999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192320999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192321000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:23.283008 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6419): Process ended prematurely: osmo-stp_10.42.42.5(pid=6419) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:23:23.293819 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 19:23:23.325222 run osmo-hlr_10.42.42.2(pid=6416): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6416)] 19:23:23.377723 run osmo-hlr_10.42.42.2(pid=6416): stdout: | (launched: 2022-12-09_19:23:19.436114) 19:23:23.431784 run osmo-hlr_10.42.42.2(pid=6416): stderr: | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192319743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192319763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192319776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192319776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192319776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:23.506411 run osmo-msc_10.42.42.6(pid=6422): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6422)] 19:23:23.559095 run osmo-msc_10.42.42.6(pid=6422): stdout: | (launched: 2022-12-09_19:23:21.968341) 19:23:23.613454 run osmo-msc_10.42.42.6(pid=6422): stderr: | [0;m[38;5;43m20221209192322474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192322474 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f843a26bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192322474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192322474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192322474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192322474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192322476 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192322477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192322477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192322477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:23.669809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Terminating (SIGTERM) 19:23:23.714370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Terminating (SIGTERM) 19:23:23.760547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6421): Terminating (SIGTERM) 19:23:23.807137 --- ParallelTerminationStrategy: PID 6415 died... 19:23:23.828013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Terminated: ok {rc=0} 19:23:23.879151 --- ParallelTerminationStrategy: PID 6418 died... 19:23:23.899715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Terminated: ok {rc=0} 19:23:23.949378 --- ParallelTerminationStrategy: PID 6421 died... 19:23:23.969884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6421): Terminated: ok {rc=0} 19:23:24.062186 bus /sierra_3: Setting Powered False 19:23:25.161680 bus /sierra_3: Setting Powered False 19:23:26.274946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:23:27.522565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:27.529124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:23:27.561998 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:23:27.588002 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:23:27.638600 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:23:27.671162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:23:27.697265 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:23:28.248604 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:23:28.303194 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.315138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:23:28.386250 tst mo_mt_call.py: using LAC 23181 19:23:28.512912 tst mo_mt_call.py: using RAC 231 19:23:28.640115 tst mo_mt_call.py: using CellId 23181 19:23:28.769747 tst mo_mt_call.py: using BVCI 23182 19:23:28.889148 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.900620 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.911934 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.923592 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.935294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:28.946902 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:23:29.065289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:23:29.188508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:29.694697 run create_hlr_db(pid=6428): Launched 19:23:29.820050 bus /sierra_2: Setting Powered False 19:23:30.898426 run create_hlr_db(pid=6428): Terminated: ok {rc=0} 19:23:31.386509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Launched 19:23:31.747245 run osmo-hlr_10.42.42.2(pid=6431): Launched 19:23:31.919554 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:32.655169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Launched 19:23:32.982412 run osmo-stp_10.42.42.5(pid=6434): Launched 19:23:33.106493 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:33.695454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6436): Launched 19:23:34.022914 run osmo-msc_10.42.42.6(pid=6437): Launched 19:23:34.205924 run osmo-stp_10.42.42.5(pid=6434): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] 19:23:34.343230 run osmo-stp_10.42.42.5(pid=6434): stdout: | (launched: 2022-12-09_19:23:32.922501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:34.480806 run osmo-stp_10.42.42.5(pid=6434): stderr: | [0;m[38;5;43m20221209192333114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192333115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192333115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192333115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:34.617496 run osmo-stp_10.42.42.5(pid=6434): stdout: | (launched: 2022-12-09_19:23:32.922501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:34.747013 run osmo-stp_10.42.42.5(pid=6434): stderr: | [0;m[38;5;43m20221209192333114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192333115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192333115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192333115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192333116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:34.902049 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6434): Process ended prematurely: osmo-stp_10.42.42.5(pid=6434) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:23:34.911735 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 19:23:34.939948 run osmo-hlr_10.42.42.2(pid=6431): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6431)] 19:23:34.990201 run osmo-hlr_10.42.42.2(pid=6431): stdout: | (launched: 2022-12-09_19:23:31.671840) 19:23:35.042018 run osmo-hlr_10.42.42.2(pid=6431): stderr: | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192332065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192332089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192332108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192332108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192332108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:35.113786 run osmo-msc_10.42.42.6(pid=6437): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6437)] 19:23:35.163485 run osmo-msc_10.42.42.6(pid=6437): stdout: | (launched: 2022-12-09_19:23:33.963169) 19:23:35.215004 run osmo-msc_10.42.42.6(pid=6437): stderr: | [0;m[38;5;43m20221209192334285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192334286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbbe1d49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192334286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192334286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192334286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192334286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192334288 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192334288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192334288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192334288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:35.266961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Terminating (SIGTERM) 19:23:35.308570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Terminating (SIGTERM) 19:23:35.350219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6436): Terminating (SIGTERM) 19:23:35.391989 --- ParallelTerminationStrategy: PID 6430 died... 19:23:35.411819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6430): Terminated: ok {rc=0} 19:23:35.458443 --- ParallelTerminationStrategy: PID 6433 died... 19:23:35.477839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6433): Terminated: ok {rc=0} 19:23:35.523786 --- ParallelTerminationStrategy: PID 6436 died... 19:23:35.543189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6436): Terminated: ok {rc=0} 19:23:35.631434 bus /sierra_3: Setting Powered False 19:23:36.731204 bus /sierra_3: Setting Powered False 19:23:37.846901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:23:38.996849 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.009659 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:23:39.081886 tst mo_mt_call_osmux.py: using LAC 23182 19:23:39.210246 tst mo_mt_call_osmux.py: using RAC 232 19:23:39.338210 tst mo_mt_call_osmux.py: using CellId 23182 19:23:39.465247 tst mo_mt_call_osmux.py: using BVCI 23183 19:23:39.582990 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.594791 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.606330 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.617919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.629583 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:23:39.640843 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:23:39.762003 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:23:39.880869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:40.388205 run create_hlr_db(pid=6439): Launched 19:23:40.511897 bus /sierra_2: Setting Powered False 19:23:41.576158 run create_hlr_db(pid=6439): Terminated: ok {rc=0} 19:23:42.029617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Launched 19:23:42.355248 run osmo-hlr_10.42.42.2(pid=6442): Launched 19:23:42.481078 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:43.044739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Launched 19:23:43.370377 run osmo-stp_10.42.42.5(pid=6445): Launched 19:23:43.495673 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:44.085917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Launched 19:23:44.410560 run osmo-msc_10.42.42.6(pid=6448): Launched 19:23:44.593189 run osmo-stp_10.42.42.5(pid=6445): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] 19:23:44.730143 run osmo-stp_10.42.42.5(pid=6445): stdout: | (launched: 2022-12-09_19:23:43.310831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:44.867683 run osmo-stp_10.42.42.5(pid=6445): stderr: | [0;m[38;5;43m20221209192343505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192343506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192343506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192343506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:45.004942 run osmo-stp_10.42.42.5(pid=6445): stdout: | (launched: 2022-12-09_19:23:43.310831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:45.134963 run osmo-stp_10.42.42.5(pid=6445): stderr: | [0;m[38;5;43m20221209192343505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192343506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192343506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192343506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:45.290595 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6445): Process ended prematurely: osmo-stp_10.42.42.5(pid=6445) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:23:45.300278 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:23:45.328917 run osmo-hlr_10.42.42.2(pid=6442): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6442)] 19:23:45.378990 run osmo-hlr_10.42.42.2(pid=6442): stdout: | (launched: 2022-12-09_19:23:42.295654) 19:23:45.430562 run osmo-hlr_10.42.42.2(pid=6442): stderr: | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192342496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192342508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:45.502128 run osmo-msc_10.42.42.6(pid=6448): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6448)] 19:23:45.552103 run osmo-msc_10.42.42.6(pid=6448): stdout: | (launched: 2022-12-09_19:23:44.351185) 19:23:45.603445 run osmo-msc_10.42.42.6(pid=6448): stderr: | [0;m[38;5;43m20221209192344673 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192344673 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd58097c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192344674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192344674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192344674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192344674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192344676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192344676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192344676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192344676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:45.655225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Terminating (SIGTERM) 19:23:45.696706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Terminating (SIGTERM) 19:23:45.738123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Terminating (SIGTERM) 19:23:45.779925 --- ParallelTerminationStrategy: PID 6441 died... 19:23:45.799746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Terminated: ok {rc=0} 19:23:45.846928 --- ParallelTerminationStrategy: PID 6444 died... 19:23:45.866711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Terminated: ok {rc=0} 19:23:45.918350 --- ParallelTerminationStrategy: PID 6447 died... 19:23:45.938285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Terminated: ok {rc=0} 19:23:46.032369 bus /sierra_3: Setting Powered False 19:23:47.136230 bus /sierra_3: Setting Powered False 19:23:48.253368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:23:49.500026 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:49.506952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:23:49.539725 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:23:49.565826 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:23:49.615387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:23:49.647759 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:23:49.673782 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:23:50.226876 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:23:50.275423 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.286387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:23:50.353363 tst mo_mt_call.py: using LAC 23183 19:23:50.470342 tst mo_mt_call.py: using RAC 233 19:23:50.589047 tst mo_mt_call.py: using CellId 23183 19:23:50.717063 tst mo_mt_call.py: using BVCI 23184 19:23:50.834786 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.846736 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.858225 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.870101 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.882013 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:23:50.893930 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:23:51.016880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:23:51.134072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:51.606265 run create_hlr_db(pid=6456): Launched 19:23:51.731380 bus /sierra_2: Setting Powered False 19:23:52.791429 run create_hlr_db(pid=6456): Terminated: ok {rc=0} 19:23:53.235554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Launched 19:23:53.561707 run osmo-hlr_10.42.42.2(pid=6459): Launched 19:23:53.687936 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:54.249179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Launched 19:23:54.573905 run osmo-stp_10.42.42.5(pid=6462): Launched 19:23:54.701404 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:55.290521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6464): Launched 19:23:55.617068 run osmo-msc_10.42.42.6(pid=6465): Launched 19:23:55.799157 run osmo-stp_10.42.42.5(pid=6462): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] 19:23:55.936300 run osmo-stp_10.42.42.5(pid=6462): stdout: | (launched: 2022-12-09_19:23:54.514183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:56.074386 run osmo-stp_10.42.42.5(pid=6462): stderr: | [0;m[38;5;43m20221209192354706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192354707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192354707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192354707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:56.210599 run osmo-stp_10.42.42.5(pid=6462): stdout: | (launched: 2022-12-09_19:23:54.514183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:56.340299 run osmo-stp_10.42.42.5(pid=6462): stderr: | [0;m[38;5;43m20221209192354706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192354707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192354707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192354707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192354710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:56.495431 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6462): Process ended prematurely: osmo-stp_10.42.42.5(pid=6462) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:23:56.505289 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:23:56.533653 run osmo-hlr_10.42.42.2(pid=6459): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6459)] 19:23:56.583659 run osmo-hlr_10.42.42.2(pid=6459): stdout: | (launched: 2022-12-09_19:23:53.502414) 19:23:56.635344 run osmo-hlr_10.42.42.2(pid=6459): stderr: | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192353703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192353716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192353724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192353724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192353724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:56.707471 run osmo-msc_10.42.42.6(pid=6465): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6465)] 19:23:56.757571 run osmo-msc_10.42.42.6(pid=6465): stdout: | (launched: 2022-12-09_19:23:55.557507) 19:23:56.809097 run osmo-msc_10.42.42.6(pid=6465): stderr: | [0;m[38;5;43m20221209192355883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192355883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff36070ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192355883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192355883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192355883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192355883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192355885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192355886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192355886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192355886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:56.861129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Terminating (SIGTERM) 19:23:56.902718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Terminating (SIGTERM) 19:23:56.944424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6464): Terminating (SIGTERM) 19:23:56.986387 --- ParallelTerminationStrategy: PID 6458 died... 19:23:57.006592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6458): Terminated: ok {rc=0} 19:23:57.053377 --- ParallelTerminationStrategy: PID 6461 died... 19:23:57.072732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6461): Terminated: ok {rc=0} 19:23:57.119087 --- ParallelTerminationStrategy: PID 6464 died... 19:23:57.138771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6464): Terminated: ok {rc=0} 19:23:57.227521 bus /sierra_3: Setting Powered False 19:23:58.327542 bus /sierra_3: Setting Powered False 19:23:59.443199 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:24:00.587057 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:00.598768 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:24:00.667622 tst mo_mt_call_osmux.py: using LAC 23184 19:24:00.787215 tst mo_mt_call_osmux.py: using RAC 234 19:24:00.916164 tst mo_mt_call_osmux.py: using CellId 23184 19:24:01.038525 tst mo_mt_call_osmux.py: using BVCI 23185 19:24:01.168400 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:01.180437 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:01.192207 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:01.204013 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:01.215770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:24:01.227456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:24:01.364315 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:24:01.487716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:01.966131 run create_hlr_db(pid=6467): Launched 19:24:02.125285 bus /sierra_2: Setting Powered False 19:24:03.185863 run create_hlr_db(pid=6467): Terminated: ok {rc=0} 19:24:03.630297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6469): Launched 19:24:03.956819 run osmo-hlr_10.42.42.2(pid=6470): Launched 19:24:04.084388 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:04.643507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6472): Launched 19:24:04.969679 run osmo-stp_10.42.42.5(pid=6473): Launched 19:24:05.095538 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:05.684804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6475): Launched 19:24:06.012683 run osmo-msc_10.42.42.6(pid=6476): Launched 19:24:06.194661 run osmo-stp_10.42.42.5(pid=6473): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6473)] 19:24:06.332747 run osmo-stp_10.42.42.5(pid=6473): stdout: | (launched: 2022-12-09_19:24:04.910138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:06.471680 run osmo-stp_10.42.42.5(pid=6473): stderr: | [0;m[38;5;43m20221209192405103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192405103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192405104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192405104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192405104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192405105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192405105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:06.609150 run osmo-stp_10.42.42.5(pid=6473): stdout: | (launched: 2022-12-09_19:24:04.910138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:06.739153 run osmo-stp_10.42.42.5(pid=6473): stderr: | [0;m[38;5;43m20221209192405103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192405103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192405104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192405104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192405104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192405105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192405105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:06.894667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6473): Process ended prematurely: osmo-stp_10.42.42.5(pid=6473) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6473)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:24:06.904642 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:24:06.933148 run osmo-hlr_10.42.42.2(pid=6470): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6470)] 19:24:06.983140 run osmo-hlr_10.42.42.2(pid=6470): stdout: | (launched: 2022-12-09_19:24:03.897388) 19:24:07.035071 run osmo-hlr_10.42.42.2(pid=6470): stderr: | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192404096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192404107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192404115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192404116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192404116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:07.107237 run osmo-msc_10.42.42.6(pid=6476): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6476)] 19:24:07.157324 run osmo-msc_10.42.42.6(pid=6476): stdout: | (launched: 2022-12-09_19:24:05.952438) 19:24:07.208670 run osmo-msc_10.42.42.6(pid=6476): stderr: | [0;m[38;5;43m20221209192406273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192406273 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2e241ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192406273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192406273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192406273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192406274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192406275 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192406276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192406276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192406276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:07.260612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6469): Terminating (SIGTERM) 19:24:07.302381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6472): Terminating (SIGTERM) 19:24:07.344128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6475): Terminating (SIGTERM) 19:24:07.386026 --- ParallelTerminationStrategy: PID 6469 died... 19:24:07.405972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6469): Terminated: ok {rc=0} 19:24:07.452746 --- ParallelTerminationStrategy: PID 6472 died... 19:24:07.472415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6472): Terminated: ok {rc=0} 19:24:07.518869 --- ParallelTerminationStrategy: PID 6475 died... 19:24:07.538461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6475): Terminated: ok {rc=0} 19:24:07.626513 bus /sierra_3: Setting Powered False 19:24:08.725636 bus /sierra_3: Setting Powered False 19:24:09.844343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:24:11.104297 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:11.111316 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:24:11.145889 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:24:11.172840 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:24:11.225550 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:24:11.259012 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:24:11.285676 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:24:11.840754 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:24:11.893817 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:11.905192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:24:11.973751 tst mo_mt_call.py: using LAC 23185 19:24:12.099103 tst mo_mt_call.py: using RAC 235 19:24:12.224103 tst mo_mt_call.py: using CellId 23185 19:24:12.348892 tst mo_mt_call.py: using BVCI 23186 19:24:12.466714 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:12.478172 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:12.489537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:12.500906 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:12.512597 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:12.524052 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:24:12.640531 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:24:12.761171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:13.234485 run create_hlr_db(pid=6481): Launched 19:24:13.358502 bus /sierra_2: Setting Powered False 19:24:14.420150 run create_hlr_db(pid=6481): Terminated: ok {rc=0} 19:24:14.865637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6483): Launched 19:24:15.192151 run osmo-hlr_10.42.42.2(pid=6484): Launched 19:24:15.315969 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:15.906498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6486): Launched 19:24:16.249807 run osmo-stp_10.42.42.5(pid=6487): Launched 19:24:16.576926 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:17.182619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6489): Launched 19:24:17.503404 run osmo-msc_10.42.42.6(pid=6490): Launched 19:24:17.674177 run osmo-stp_10.42.42.5(pid=6487): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6487)] 19:24:17.803442 run osmo-stp_10.42.42.5(pid=6487): stdout: | (launched: 2022-12-09_19:24:16.187882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:17.931732 run osmo-stp_10.42.42.5(pid=6487): stderr: | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192416445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192416448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:18.058191 run osmo-stp_10.42.42.5(pid=6487): stdout: | (launched: 2022-12-09_19:24:16.187882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:18.179114 run osmo-stp_10.42.42.5(pid=6487): stderr: | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192416444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192416445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192416448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:18.323862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6487): Process ended prematurely: osmo-stp_10.42.42.5(pid=6487) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6487)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:24:18.332839 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:24:18.359022 run osmo-hlr_10.42.42.2(pid=6484): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6484)] 19:24:18.406428 run osmo-hlr_10.42.42.2(pid=6484): stdout: | (launched: 2022-12-09_19:24:15.132436) 19:24:18.455355 run osmo-hlr_10.42.42.2(pid=6484): stderr: | [0;m[1;31m20221209192415330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192415330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192415330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192415330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192415330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192415331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192415343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192415351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192415351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192415351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:18.523645 run osmo-msc_10.42.42.6(pid=6490): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6490)] 19:24:18.571176 run osmo-msc_10.42.42.6(pid=6490): stdout: | (launched: 2022-12-09_19:24:17.446651) 19:24:18.619802 run osmo-msc_10.42.42.6(pid=6490): stderr: | [0;m[38;5;43m20221209192417722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192417722 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e08b1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192417722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192417722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192417722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192417722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192417725 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192417725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192417726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192417726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:18.668867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6483): Terminating (SIGTERM) 19:24:18.707792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6486): Terminating (SIGTERM) 19:24:18.746697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6489): Terminating (SIGTERM) 19:24:18.785841 --- ParallelTerminationStrategy: PID 6483 died... 19:24:18.804354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6483): Terminated: ok {rc=0} 19:24:18.848053 --- ParallelTerminationStrategy: PID 6486 died... 19:24:18.866321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6486): Terminated: ok {rc=0} 19:24:18.909468 --- ParallelTerminationStrategy: PID 6489 died... 19:24:18.927768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6489): Terminated: ok {rc=0} 19:24:19.011730 bus /sierra_3: Setting Powered False 19:24:20.110297 bus /sierra_3: Setting Powered False 19:24:21.229401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:24:22.379899 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:22.392056 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:24:22.463394 tst mo_mt_call_osmux.py: using LAC 23186 19:24:22.590351 tst mo_mt_call_osmux.py: using RAC 236 19:24:22.717360 tst mo_mt_call_osmux.py: using CellId 23186 19:24:22.849462 tst mo_mt_call_osmux.py: using BVCI 23187 19:24:22.966631 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:22.978177 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:22.989429 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:23.001060 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:23.013090 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:24:23.025291 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:24:23.141858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:24:23.261078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:23.760267 run create_hlr_db(pid=6492): Launched 19:24:23.882737 bus /sierra_2: Setting Powered False 19:24:24.946206 run create_hlr_db(pid=6492): Terminated: ok {rc=0} 19:24:25.377348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6494): Launched 19:24:25.678449 run osmo-hlr_10.42.42.2(pid=6495): Launched 19:24:25.791992 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:26.307888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6497): Launched 19:24:26.606829 run osmo-stp_10.42.42.5(pid=6498): Launched 19:24:26.720346 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:27.261798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6500): Launched 19:24:27.561364 run osmo-msc_10.42.42.6(pid=6501): Launched 19:24:27.728316 run osmo-stp_10.42.42.5(pid=6498): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6498)] 19:24:27.855364 run osmo-stp_10.42.42.5(pid=6498): stdout: | (launched: 2022-12-09_19:24:26.551324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:27.981672 run osmo-stp_10.42.42.5(pid=6498): stderr: | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192426723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:28.105822 run osmo-stp_10.42.42.5(pid=6498): stdout: | (launched: 2022-12-09_19:24:26.551324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:28.224430 run osmo-stp_10.42.42.5(pid=6498): stderr: | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192426722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192426723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192426723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:28.366299 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6498): Process ended prematurely: osmo-stp_10.42.42.5(pid=6498) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6498)] [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:24:28.375048 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:24:28.400810 run osmo-hlr_10.42.42.2(pid=6495): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6495)] 19:24:28.446970 run osmo-hlr_10.42.42.2(pid=6495): stdout: | (launched: 2022-12-09_19:24:25.622754) 19:24:28.494900 run osmo-hlr_10.42.42.2(pid=6495): stderr: | [0;m[1;31m20221209192425799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192425799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192425799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192425799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192425800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192425800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192425811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192425820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192425821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192425821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:28.561904 run osmo-msc_10.42.42.6(pid=6501): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6501)] 19:24:28.608369 run osmo-msc_10.42.42.6(pid=6501): stdout: | (launched: 2022-12-09_19:24:27.505340) 19:24:28.656307 run osmo-msc_10.42.42.6(pid=6501): stderr: | [0;m[38;5;43m20221209192427780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192427780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07920cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192427780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192427780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192427780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192427781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192427782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192427783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192427783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192427783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:28.704379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6494): Terminating (SIGTERM) 19:24:28.743043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6497): Terminating (SIGTERM) 19:24:28.781654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6500): Terminating (SIGTERM) 19:24:28.820371 --- ParallelTerminationStrategy: PID 6494 died... 19:24:28.838950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6494): Terminated: ok {rc=0} 19:24:28.881853 --- ParallelTerminationStrategy: PID 6497 died... 19:24:28.900211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6497): Terminated: ok {rc=0} 19:24:28.942794 --- ParallelTerminationStrategy: PID 6500 died... 19:24:28.960891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6500): Terminated: ok {rc=0} 19:24:29.045351 bus /sierra_3: Setting Powered False 19:24:30.142374 bus /sierra_3: Setting Powered False 19:24:31.251260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:24:32.494750 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:32.500874 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:24:32.532991 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:24:32.558780 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:24:32.610335 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:24:32.642962 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:24:32.668716 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:24:33.217778 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:24:33.264933 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.275854 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:24:33.343769 tst mo_mt_call.py: using LAC 23187 19:24:33.469341 tst mo_mt_call.py: using RAC 237 19:24:33.593751 tst mo_mt_call.py: using CellId 23187 19:24:33.711692 tst mo_mt_call.py: using BVCI 23188 19:24:33.820462 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.831341 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.842068 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.852709 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.863492 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:33.874175 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:24:33.992850 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:24:34.113261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:34.607325 run create_hlr_db(pid=6506): Launched 19:24:34.729089 bus /sierra_2: Setting Powered False 19:24:35.792326 run create_hlr_db(pid=6506): Terminated: ok {rc=0} 19:24:36.219401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6508): Launched 19:24:36.517548 run osmo-hlr_10.42.42.2(pid=6509): Launched 19:24:36.631391 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:37.157913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6511): Launched 19:24:37.455513 run osmo-stp_10.42.42.5(pid=6512): Launched 19:24:37.569109 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:38.108503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6514): Launched 19:24:38.405648 run osmo-msc_10.42.42.6(pid=6515): Launched 19:24:38.571730 run osmo-stp_10.42.42.5(pid=6512): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6512)] 19:24:38.697889 run osmo-stp_10.42.42.5(pid=6512): stdout: | (launched: 2022-12-09_19:24:37.400722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:38.824090 run osmo-stp_10.42.42.5(pid=6512): stderr: | [0;m[38;5;43m20221209192437568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192437569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192437569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192437569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:38.947928 run osmo-stp_10.42.42.5(pid=6512): stdout: | (launched: 2022-12-09_19:24:37.400722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:39.066796 run osmo-stp_10.42.42.5(pid=6512): stderr: | [0;m[38;5;43m20221209192437568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192437569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192437569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192437569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192437570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:39.208586 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6512): Process ended prematurely: osmo-stp_10.42.42.5(pid=6512) [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6512)] [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:24:39.217559 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:24:39.243528 run osmo-hlr_10.42.42.2(pid=6509): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6509)] 19:24:39.289993 run osmo-hlr_10.42.42.2(pid=6509): stdout: | (launched: 2022-12-09_19:24:36.462744) 19:24:39.338378 run osmo-hlr_10.42.42.2(pid=6509): stderr: | [0;m[1;31m20221209192436637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192436637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192436637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192436637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192436637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192436638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192436650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192436658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192436659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192436659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:39.405715 run osmo-msc_10.42.42.6(pid=6515): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6515)] 19:24:39.452201 run osmo-msc_10.42.42.6(pid=6515): stdout: | (launched: 2022-12-09_19:24:38.351023) 19:24:39.500088 run osmo-msc_10.42.42.6(pid=6515): stderr: | [0;m[38;5;43m20221209192438622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192438622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1b5c53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192438622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192438622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192438623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192438623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192438625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192438625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192438625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192438625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:39.548273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6508): Terminating (SIGTERM) 19:24:39.586673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6511): Terminating (SIGTERM) 19:24:39.625642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6514): Terminating (SIGTERM) 19:24:39.664753 --- ParallelTerminationStrategy: PID 6508 died... 19:24:39.683507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6508): Terminated: ok {rc=0} 19:24:39.726253 --- ParallelTerminationStrategy: PID 6511 died... 19:24:39.744428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6511): Terminated: ok {rc=0} 19:24:39.787042 --- ParallelTerminationStrategy: PID 6514 died... 19:24:39.805528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6514): Terminated: ok {rc=0} 19:24:39.886941 bus /sierra_3: Setting Powered False 19:24:40.981031 bus /sierra_3: Setting Powered False 19:24:42.091331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:24:43.230944 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.242433 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:24:43.311023 tst mo_mt_call_osmux.py: using LAC 23188 19:24:43.431808 tst mo_mt_call_osmux.py: using RAC 238 19:24:43.548396 tst mo_mt_call_osmux.py: using CellId 23188 19:24:43.663330 tst mo_mt_call_osmux.py: using BVCI 23189 19:24:43.771382 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.782555 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.793402 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.804392 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.815406 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:24:43.826415 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:24:43.942860 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:24:44.059740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:44.524004 run create_hlr_db(pid=6517): Launched 19:24:44.645522 bus /sierra_2: Setting Powered False 19:24:45.705539 run create_hlr_db(pid=6517): Terminated: ok {rc=0} 19:24:46.166497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Launched 19:24:46.478230 run osmo-hlr_10.42.42.2(pid=6520): Launched 19:24:46.791558 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:47.395037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Launched 19:24:47.713435 run osmo-stp_10.42.42.5(pid=6523): Launched 19:24:47.835581 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:48.418160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6525): Launched 19:24:48.737407 run osmo-msc_10.42.42.6(pid=6526): Launched 19:24:48.915533 run osmo-stp_10.42.42.5(pid=6523): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] 19:24:49.051361 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-09_19:24:47.655462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:49.187170 run osmo-stp_10.42.42.5(pid=6523): stderr: | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192447848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:49.322133 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-09_19:24:47.655462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:49.449494 run osmo-stp_10.42.42.5(pid=6523): stderr: | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192447847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192447848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192447848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:49.602547 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:24:49.612053 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:24:49.640350 run osmo-hlr_10.42.42.2(pid=6520): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6520)] 19:24:49.689849 run osmo-hlr_10.42.42.2(pid=6520): stdout: | (launched: 2022-12-09_19:24:46.422255) 19:24:49.741117 run osmo-hlr_10.42.42.2(pid=6520): stderr: | [0;m[1;31m20221209192446654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192446654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192446654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192446654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192446654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192446655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192446679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192446692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192446692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192446692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:49.812417 run osmo-msc_10.42.42.6(pid=6526): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6526)] 19:24:49.861755 run osmo-msc_10.42.42.6(pid=6526): stdout: | (launched: 2022-12-09_19:24:48.679199) 19:24:49.912907 run osmo-msc_10.42.42.6(pid=6526): stderr: | [0;m[38;5;43m20221209192449000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192449001 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f073478ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192449001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192449001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192449001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192449001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192449003 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192449003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192449003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192449003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:49.964127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Terminating (SIGTERM) 19:24:50.005224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminating (SIGTERM) 19:24:50.047022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6525): Terminating (SIGTERM) 19:24:50.088489 --- ParallelTerminationStrategy: PID 6519 died... 19:24:50.109605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6519): Terminated: ok {rc=0} 19:24:50.152297 --- ParallelTerminationStrategy: PID 6522 died... 19:24:50.170530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminated: ok {rc=0} 19:24:50.213196 --- ParallelTerminationStrategy: PID 6525 died... 19:24:50.231358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6525): Terminated: ok {rc=0} 19:24:50.315011 bus /sierra_3: Setting Powered False 19:24:51.420202 bus /sierra_3: Setting Powered False 19:24:52.536525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:24:53.779128 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:53.784626 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:24:53.818204 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:24:53.843763 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:24:53.894341 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:24:53.926669 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:24:53.952254 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:24:54.503873 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:24:54.555744 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:54.567081 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:24:54.642641 tst mo_mt_call.py: using LAC 23189 19:24:54.766425 tst mo_mt_call.py: using RAC 239 19:24:54.888356 tst mo_mt_call.py: using CellId 23189 19:24:55.010207 tst mo_mt_call.py: using BVCI 23190 19:24:55.124661 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:55.135921 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:55.147020 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:55.158533 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:55.170105 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:24:55.181623 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:24:55.296455 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:24:55.409366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:55.866411 run create_hlr_db(pid=6532): Launched 19:24:55.986253 bus /sierra_2: Setting Powered False 19:24:57.045176 run create_hlr_db(pid=6532): Terminated: ok {rc=0} 19:24:57.456292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Launched 19:24:57.771077 run osmo-hlr_10.42.42.2(pid=6535): Launched 19:24:57.891306 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:58.430755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Launched 19:24:58.743464 run osmo-stp_10.42.42.5(pid=6538): Launched 19:24:58.862487 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:59.431903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6540): Launched 19:24:59.747354 run osmo-msc_10.42.42.6(pid=6541): Launched 19:24:59.924086 run osmo-stp_10.42.42.5(pid=6538): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] 19:25:00.058394 run osmo-stp_10.42.42.5(pid=6538): stdout: | (launched: 2022-12-09_19:24:58.686659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:00.192676 run osmo-stp_10.42.42.5(pid=6538): stderr: | [0;m[38;5;43m20221209192458874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192458874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192458875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192458875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192458875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192458875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192458876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:00.326043 run osmo-stp_10.42.42.5(pid=6538): stdout: | (launched: 2022-12-09_19:24:58.686659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:00.452251 run osmo-stp_10.42.42.5(pid=6538): stderr: | [0;m[38;5;43m20221209192458874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192458874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192458875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192458875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192458875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192458875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192458876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:00.614109 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6538): Process ended prematurely: osmo-stp_10.42.42.5(pid=6538) [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:25:00.623704 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:25:00.651300 run osmo-hlr_10.42.42.2(pid=6535): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6535)] 19:25:00.700699 run osmo-hlr_10.42.42.2(pid=6535): stdout: | (launched: 2022-12-09_19:24:57.714260) 19:25:00.751661 run osmo-hlr_10.42.42.2(pid=6535): stderr: | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192457908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192457920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192457929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192457929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192457929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:00.823145 run osmo-msc_10.42.42.6(pid=6541): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6541)] 19:25:00.877490 run osmo-msc_10.42.42.6(pid=6541): stdout: | (launched: 2022-12-09_19:24:59.690072) 19:25:00.932458 run osmo-msc_10.42.42.6(pid=6541): stderr: | [0;m[38;5;43m20221209192500008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192500009 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa654ed7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192500009 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192500009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192500009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192500009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192500011 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192500011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192500011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192500011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:00.984252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Terminating (SIGTERM) 19:25:01.026736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Terminating (SIGTERM) 19:25:01.070786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6540): Terminating (SIGTERM) 19:25:01.114941 --- ParallelTerminationStrategy: PID 6534 died... 19:25:01.134740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Terminated: ok {rc=0} 19:25:01.182675 --- ParallelTerminationStrategy: PID 6537 died... 19:25:01.202286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Terminated: ok {rc=0} 19:25:01.248698 --- ParallelTerminationStrategy: PID 6540 died... 19:25:01.268366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6540): Terminated: ok {rc=0} 19:25:01.356584 bus /sierra_3: Setting Powered False 19:25:02.470386 bus /sierra_3: Setting Powered False 19:25:03.583385 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:25:04.728397 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:04.740097 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:25:04.810573 tst mo_mt_call_osmux.py: using LAC 23190 19:25:04.934611 tst mo_mt_call_osmux.py: using RAC 240 19:25:05.056634 tst mo_mt_call_osmux.py: using CellId 23190 19:25:05.179054 tst mo_mt_call_osmux.py: using BVCI 23191 19:25:05.292144 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:05.303179 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:05.314065 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:05.325204 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:05.336205 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:25:05.347405 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:25:05.461390 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:25:05.574834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:06.025875 run create_hlr_db(pid=6546): Launched 19:25:06.144609 bus /sierra_2: Setting Powered False 19:25:07.203305 run create_hlr_db(pid=6546): Terminated: ok {rc=0} 19:25:07.609136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6548): Launched 19:25:07.899199 run osmo-hlr_10.42.42.2(pid=6549): Launched 19:25:08.008354 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:08.506240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6551): Launched 19:25:08.795522 run osmo-stp_10.42.42.5(pid=6552): Launched 19:25:08.905526 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:09.430585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6554): Launched 19:25:09.720242 run osmo-msc_10.42.42.6(pid=6555): Launched 19:25:09.882053 run osmo-stp_10.42.42.5(pid=6552): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6552)] 19:25:10.005773 run osmo-stp_10.42.42.5(pid=6552): stdout: | (launched: 2022-12-09_19:25:08.743208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:10.129457 run osmo-stp_10.42.42.5(pid=6552): stderr: | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192508907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:10.250655 run osmo-stp_10.42.42.5(pid=6552): stdout: | (launched: 2022-12-09_19:25:08.743208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:10.366929 run osmo-stp_10.42.42.5(pid=6552): stderr: | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192508906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192508907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192508907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:10.505995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6552): Process ended prematurely: osmo-stp_10.42.42.5(pid=6552) [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6552)] [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:25:10.514701 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 19:25:10.540373 run osmo-hlr_10.42.42.2(pid=6549): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6549)] 19:25:10.587066 run osmo-hlr_10.42.42.2(pid=6549): stdout: | (launched: 2022-12-09_19:25:07.846469) 19:25:10.634993 run osmo-hlr_10.42.42.2(pid=6549): stderr: | [0;m[1;31m20221209192508017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192508017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192508017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192508017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192508018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192508018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192508034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192508043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192508044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192508044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:10.701418 run osmo-msc_10.42.42.6(pid=6555): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6555)] 19:25:10.747421 run osmo-msc_10.42.42.6(pid=6555): stdout: | (launched: 2022-12-09_19:25:09.667845) 19:25:10.795596 run osmo-msc_10.42.42.6(pid=6555): stderr: | [0;m[38;5;43m20221209192509936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192509937 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2428012c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192509937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192509937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192509937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192509937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192509939 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192509939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192509939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192509939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:10.844182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6548): Terminating (SIGTERM) 19:25:10.883019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6551): Terminating (SIGTERM) 19:25:10.921540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6554): Terminating (SIGTERM) 19:25:10.960458 --- ParallelTerminationStrategy: PID 6548 died... 19:25:10.979034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6548): Terminated: ok {rc=0} 19:25:11.022404 --- ParallelTerminationStrategy: PID 6551 died... 19:25:11.040555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6551): Terminated: ok {rc=0} 19:25:11.083815 --- ParallelTerminationStrategy: PID 6554 died... 19:25:11.102349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6554): Terminated: ok {rc=0} 19:25:11.185939 bus /sierra_3: Setting Powered False 19:25:12.286680 bus /sierra_3: Setting Powered False 19:25:13.402851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:trx-lms --------------------------------------------------------------------- 19:25:14.644280 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:14.650114 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 19:25:14.684514 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:25:14.711245 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 19:25:14.795435 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 19:25:14.828865 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:25:14.855915 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 19:25:15.438653 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 19:25:15.444031 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:15.454797 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:25:15.504555 tst emergency_mo_mt_call.py: using LAC 23191 19:25:15.624925 tst emergency_mo_mt_call.py: using RAC 241 19:25:15.743548 tst emergency_mo_mt_call.py: using CellId 23191 19:25:15.872761 tst emergency_mo_mt_call.py: using BVCI 23192 19:25:16.010125 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:16.021581 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:16.032628 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:16.043946 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:16.054882 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:16.066192 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:16.184588 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:16.336750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:16.830502 run create_hlr_db(pid=6560): Launched 19:25:16.968822 bus /sierra_2: Setting Powered False 19:25:18.027417 run create_hlr_db(pid=6560): Terminated: ok {rc=0} 19:25:18.433505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Launched 19:25:18.723455 run osmo-hlr_10.42.42.2(pid=6563): Launched 19:25:18.832520 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:19.331122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Launched 19:25:19.619812 run osmo-stp_10.42.42.5(pid=6566): Launched 19:25:19.738860 tst emergency_mo_mt_call.py: using MSISDN 7337 19:25:19.885431 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:20.409167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6568): Launched 19:25:20.699171 run osmo-msc_10.42.42.6(pid=6569): Launched 19:25:20.863290 run osmo-stp_10.42.42.5(pid=6566): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] 19:25:20.986078 run osmo-stp_10.42.42.5(pid=6566): stdout: | (launched: 2022-12-09_19:25:19.566776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:21.109195 run osmo-stp_10.42.42.5(pid=6566): stderr: | [0;m[38;5;43m20221209192519733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192519734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192519734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192519734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:21.230206 run osmo-stp_10.42.42.5(pid=6566): stdout: | (launched: 2022-12-09_19:25:19.566776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:21.346257 run osmo-stp_10.42.42.5(pid=6566): stderr: | [0;m[38;5;43m20221209192519733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192519734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192519734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192519734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192519735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:21.485450 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6566): Process ended prematurely: osmo-stp_10.42.42.5(pid=6566) [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 19:25:21.493442 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 19:25:21.518464 run osmo-hlr_10.42.42.2(pid=6563): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6563)] 19:25:21.564327 run osmo-hlr_10.42.42.2(pid=6563): stdout: | (launched: 2022-12-09_19:25:18.670184) 19:25:21.611934 run osmo-hlr_10.42.42.2(pid=6563): stderr: | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192518845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192518858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192518867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192518867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192518867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:21.678150 run osmo-msc_10.42.42.6(pid=6569): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6569)] 19:25:21.724038 run osmo-msc_10.42.42.6(pid=6569): stdout: | (launched: 2022-12-09_19:25:20.645943) 19:25:21.771547 run osmo-msc_10.42.42.6(pid=6569): stderr: | [0;m[38;5;43m20221209192520918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192520918 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ab68bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192520918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192520918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192520918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192520918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192520920 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192520921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192520921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192520921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:21.819922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Terminating (SIGTERM) 19:25:21.858030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Terminating (SIGTERM) 19:25:21.896120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6568): Terminating (SIGTERM) 19:25:21.934361 --- ParallelTerminationStrategy: PID 6562 died... 19:25:21.952516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Terminated: ok {rc=0} 19:25:21.995206 --- ParallelTerminationStrategy: PID 6565 died... 19:25:22.013240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Terminated: ok {rc=0} 19:25:22.055605 --- ParallelTerminationStrategy: PID 6568 died... 19:25:22.073574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6568): Terminated: ok {rc=0} 19:25:22.154594 bus /sierra_3: Setting Powered False 19:25:23.250391 bus /sierra_3: Setting Powered False 19:25:24.363799 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 19:25:25.448168 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:25.459835 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:25:25.509581 tst emergency_preemptive_call.py: using LAC 23192 19:25:25.631951 tst emergency_preemptive_call.py: using RAC 242 19:25:25.754406 tst emergency_preemptive_call.py: using CellId 23192 19:25:25.869458 tst emergency_preemptive_call.py: using BVCI 23193 19:25:25.979349 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:25.990060 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:26.000422 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:26.011388 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:26.022385 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:25:26.033631 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:26.151224 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:26.268548 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:26.382473 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:25:26.494353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:26.949130 run create_hlr_db(pid=6571): Launched 19:25:27.069541 bus /sierra_2: Setting Powered False 19:25:28.128046 run create_hlr_db(pid=6571): Terminated: ok {rc=0} 19:25:28.535286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6573): Launched 19:25:28.825875 run osmo-hlr_10.42.42.2(pid=6574): Launched 19:25:28.935901 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:29.435450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6576): Launched 19:25:29.726466 run osmo-stp_10.42.42.5(pid=6577): Launched 19:25:29.848756 tst emergency_preemptive_call.py: using MSISDN 7338 19:25:29.999382 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:30.525061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6579): Launched 19:25:30.816068 run osmo-msc_10.42.42.6(pid=6580): Launched 19:25:31.122424 run osmo-stp_10.42.42.5(pid=6577): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6577)] 19:25:31.435152 run osmo-stp_10.42.42.5(pid=6577): stdout: | (launched: 2022-12-09_19:25:29.673088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:31.667894 run osmo-stp_10.42.42.5(pid=6577): stderr: | [0;m[38;5;43m20221209192529838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192529839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:31.888012 run osmo-stp_10.42.42.5(pid=6577): stdout: | (launched: 2022-12-09_19:25:29.673088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:32.046049 run osmo-stp_10.42.42.5(pid=6577): stderr: | [0;m[38;5;43m20221209192529838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192529839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:32.235896 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6577): Process ended prematurely: osmo-stp_10.42.42.5(pid=6577) [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6577)] [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py:32] 19:25:32.245533 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 19:25:32.275254 run osmo-hlr_10.42.42.2(pid=6574): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6574)] 19:25:32.329433 run osmo-hlr_10.42.42.2(pid=6574): stdout: | (launched: 2022-12-09_19:25:28.772307) 19:25:32.378716 run osmo-hlr_10.42.42.2(pid=6574): stderr: | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192528941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192528953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192528963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192528963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192528963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:32.446328 run osmo-msc_10.42.42.6(pid=6580): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6580)] 19:25:32.493056 run osmo-msc_10.42.42.6(pid=6580): stdout: | (launched: 2022-12-09_19:25:30.762382) 19:25:32.541413 run osmo-msc_10.42.42.6(pid=6580): stderr: | [0;m[38;5;43m20221209192531427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209192531428 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf49c62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209192531429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209192531430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209192531431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209192531433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209192531443 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209192531445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209192531447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209192531447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:32.589911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6573): Terminating (SIGTERM) 19:25:32.629037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6576): Terminating (SIGTERM) 19:25:32.668131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6579): Terminating (SIGTERM) 19:25:32.707286 --- ParallelTerminationStrategy: PID 6573 died... 19:25:32.725794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6573): Terminated: ok {rc=0} 19:25:32.768575 --- ParallelTerminationStrategy: PID 6576 died... 19:25:32.787036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6576): Terminated: ok {rc=0} 19:25:32.830319 --- ParallelTerminationStrategy: PID 6579 died... 19:25:32.848615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6579): Terminated: ok {rc=0} 19:25:32.932747 bus /sierra_9: Setting Powered False 19:25:34.031362 bus /sierra_9: Setting Powered False 19:25:35.146221 bus /sierra_8: Setting Powered False 19:25:36.243593 bus /sierra_8: Setting Powered False 19:25:37.357199 bus /sierra_3: Setting Powered False 19:25:38.455473 bus /sierra_3: Setting Powered False 19:25:39.572098 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms --------------------------------------------------------------------- 19:25:40.846859 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:40.851375 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 19:25:40.885636 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 19:25:40.924368 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 19:25:41.011598 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 19:25:41.045102 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 19:25:41.084244 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 19:25:41.674790 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 19:25:41.727144 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:41.738157 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:25:41.786955 tst cs_paging_gprs_active.py: using LAC 23193 19:25:41.915158 tst cs_paging_gprs_active.py: using RAC 243 19:25:42.051187 tst cs_paging_gprs_active.py: using CellId 23193 19:25:42.175464 tst cs_paging_gprs_active.py: using BVCI 23194 19:25:42.292572 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.303476 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.314180 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.325050 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.335850 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.346634 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.357658 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.368545 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:42.379514 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:25:42.493668 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:25:42.612013 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:25:42.829660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:43.149962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6587): Launched 19:25:43.426760 run iperf3-srv_10.42.42.10(pid=6588): Launched 19:25:43.545588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:25:43.760311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:44.079526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6589): Launched 19:25:44.355673 run iperf3-srv_10.42.42.10(pid=6590): Launched 19:25:44.474347 tst cs_paging_gprs_active.py:38: start network... 19:25:44.689208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:45.181593 run create_hlr_db(pid=6591): Launched 19:25:45.302861 bus /sierra_2: Setting Powered False 19:25:46.365694 run create_hlr_db(pid=6591): Terminated: ok {rc=0} 19:25:46.814816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Launched 19:25:47.147413 run osmo-hlr_10.42.42.2(pid=6594): Launched 19:25:47.281556 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:47.796306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Launched 19:25:48.092781 run osmo-stp_10.42.42.5(pid=6597): Launched 19:25:48.205901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:48.717059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6599): Launched 19:25:48.830204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:49.081465 run patchelf(pid=6600): Launched 19:25:49.245781 run osmo-stp_10.42.42.5(pid=6597): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] 19:25:49.371685 run osmo-stp_10.42.42.5(pid=6597): stdout: | (launched: 2022-12-09_19:25:48.038556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:49.499098 run osmo-stp_10.42.42.5(pid=6597): stderr: | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192548207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:49.626553 run osmo-stp_10.42.42.5(pid=6597): stdout: | (launched: 2022-12-09_19:25:48.038556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:49.748046 run osmo-stp_10.42.42.5(pid=6597): stderr: | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192548206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192548207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:49.892378 run patchelf(pid=6600): Terminating (SIGINT) 19:25:50.058971 run patchelf(pid=6600): Terminated: ok {rc=0} 19:25:50.179147 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6597): Process ended prematurely: osmo-stp_10.42.42.5(pid=6597) [trial-2363↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] [trial-2363↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 19:25:50.188476 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:25:50.214999 run osmo-hlr_10.42.42.2(pid=6594): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6594)] 19:25:50.261748 run osmo-hlr_10.42.42.2(pid=6594): stdout: | (launched: 2022-12-09_19:25:47.088278) 19:25:50.309680 run osmo-hlr_10.42.42.2(pid=6594): stderr: | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192547285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192547297 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192547306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192547307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192547307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:50.358055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6587): Terminating (SIGTERM) 19:25:50.396653 run iperf3-srv_10.42.42.10(pid=6588): Terminating (SIGTERM) 19:25:50.435137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6589): Terminating (SIGTERM) 19:25:50.473955 run iperf3-srv_10.42.42.10(pid=6590): Terminating (SIGTERM) 19:25:50.512263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Terminating (SIGTERM) 19:25:50.550652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Terminating (SIGTERM) 19:25:50.589094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6599): Terminating (SIGTERM) 19:25:50.627774 --- ParallelTerminationStrategy: PID 6587 died... 19:25:50.646340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6587): Terminated: ok {rc=0} 19:25:50.689844 --- ParallelTerminationStrategy: PID 6588 died... 19:25:50.707832 run iperf3-srv_10.42.42.10(pid=6588): Terminated {rc=256} 19:25:50.750634 --- ParallelTerminationStrategy: PID 6589 died... 19:25:50.768888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6589): Terminated: ok {rc=0} 19:25:50.811962 --- ParallelTerminationStrategy: PID 6590 died... 19:25:50.830255 run iperf3-srv_10.42.42.10(pid=6590): Terminated {rc=256} 19:25:50.873138 --- ParallelTerminationStrategy: PID 6593 died... 19:25:50.891116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Terminated: ok {rc=0} 19:25:50.933997 --- ParallelTerminationStrategy: PID 6596 died... 19:25:50.952160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Terminated: ok {rc=0} 19:25:50.994891 --- ParallelTerminationStrategy: PID 6599 died... 19:25:51.013089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6599): Terminated: ok {rc=0} 19:25:51.097755 bus /gobi_0: Setting Powered False 19:25:52.195988 bus /gobi_0: Setting Powered False 19:25:53.310354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms iperf3.py ---------------------------------------------- 19:25:54.453979 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:54.464886 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:25:54.517433 tst iperf3.py: using LAC 23194 19:25:54.633362 tst iperf3.py: using RAC 244 19:25:54.748207 tst iperf3.py: using CellId 23194 19:25:54.862651 tst iperf3.py: using BVCI 23195 19:25:54.971236 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:54.981726 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:54.991815 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.001954 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.011939 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.022017 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.032283 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.042388 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:25:55.052482 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:25:55.164743 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:25:55.370388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:55.670966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6601): Launched 19:25:55.929370 run iperf3-srv_10.42.42.10(pid=6602): Launched 19:25:56.040124 tst iperf3.py:8: start network... 19:25:56.239715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:56.700677 run create_hlr_db(pid=6603): Launched 19:25:56.821690 bus /gobi_6: Setting Powered False 19:25:57.881336 run create_hlr_db(pid=6603): Terminated: ok {rc=0} 19:25:58.315934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Launched 19:25:58.635489 run osmo-hlr_10.42.42.2(pid=6606): Launched 19:25:58.757955 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:59.308380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Launched 19:25:59.627303 run osmo-stp_10.42.42.5(pid=6609): Launched 19:25:59.749364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:00.300472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6611): Launched 19:26:00.422158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:00.690441 run patchelf(pid=6612): Launched 19:26:00.868455 run osmo-stp_10.42.42.5(pid=6609): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] 19:26:01.010561 run osmo-stp_10.42.42.5(pid=6609): stdout: | (launched: 2022-12-09_19:25:59.569224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:01.150503 run osmo-stp_10.42.42.5(pid=6609): stderr: | [0;m[38;5;43m20221209192559756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192559756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192559757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192559757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192559757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192559758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192559758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:01.290794 run osmo-stp_10.42.42.5(pid=6609): stdout: | (launched: 2022-12-09_19:25:59.569224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:01.424898 run osmo-stp_10.42.42.5(pid=6609): stderr: | [0;m[38;5;43m20221209192559756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192559756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192559757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192559757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192559757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192559758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192559758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:01.584048 run patchelf(pid=6612): Terminating (SIGINT) 19:26:01.766605 run patchelf(pid=6612): Terminated: ok {rc=0} 19:26:01.899976 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6609): Process ended prematurely: osmo-stp_10.42.42.5(pid=6609) [trial-2363↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] [trial-2363↪gprs:trx-lms↪iperf3.py:8] 19:26:01.911048 tst iperf3.py:8: Test FAILED (7.5 sec) 19:26:01.942314 run osmo-hlr_10.42.42.2(pid=6606): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6606)] 19:26:01.993521 run osmo-hlr_10.42.42.2(pid=6606): stdout: | (launched: 2022-12-09_19:25:58.577633) 19:26:02.046580 run osmo-hlr_10.42.42.2(pid=6606): stderr: | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192558770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192558782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192558791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192558791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192558791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:02.100517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6601): Terminating (SIGTERM) 19:26:02.144032 run iperf3-srv_10.42.42.10(pid=6602): Terminating (SIGTERM) 19:26:02.189576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Terminating (SIGTERM) 19:26:02.232071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Terminating (SIGTERM) 19:26:02.273562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6611): Terminating (SIGTERM) 19:26:02.315164 --- ParallelTerminationStrategy: PID 6601 died... 19:26:02.334692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6601): Terminated: ok {rc=0} 19:26:02.381219 --- ParallelTerminationStrategy: PID 6602 died... 19:26:02.400166 run iperf3-srv_10.42.42.10(pid=6602): Terminated {rc=256} 19:26:02.446254 --- ParallelTerminationStrategy: PID 6605 died... 19:26:02.465216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Terminated: ok {rc=0} 19:26:02.511579 --- ParallelTerminationStrategy: PID 6608 died... 19:26:02.530558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Terminated: ok {rc=0} 19:26:02.576846 --- ParallelTerminationStrategy: PID 6611 died... 19:26:02.596353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6611): Terminated: ok {rc=0} 19:26:02.682959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms iperf3m4.py ---------------------------------------------- 19:26:03.825957 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:03.837060 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:26:03.888172 tst iperf3m4.py: using LAC 23195 19:26:04.004463 tst iperf3m4.py: using RAC 245 19:26:04.120386 tst iperf3m4.py: using CellId 23195 19:26:04.238254 tst iperf3m4.py: using BVCI 23196 19:26:04.346565 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.357368 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.367722 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.378346 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.388763 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.399018 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.409859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.420292 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:04.430927 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:04.543252 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:04.663031 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:04.780690 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:04.897678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:26:05.113947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:05.433146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6613): Launched 19:26:05.709413 run iperf3-srv_10.42.42.10(pid=6614): Launched 19:26:05.828443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:26:06.043860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:06.363731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6615): Launched 19:26:06.640514 run iperf3-srv_10.42.42.10(pid=6616): Launched 19:26:06.759788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:26:06.975602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:07.295802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6617): Launched 19:26:07.571514 run iperf3-srv_10.42.42.10(pid=6618): Launched 19:26:07.690227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:26:07.904892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:08.223953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Launched 19:26:08.499416 run iperf3-srv_10.42.42.10(pid=6620): Launched 19:26:08.618245 tst iperf3m4.py:8: start network... 19:26:08.833301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:09.326348 run create_hlr_db(pid=6621): Launched 19:26:09.446761 bus /gobi_6: Setting Powered False 19:26:10.509611 run create_hlr_db(pid=6621): Terminated: ok {rc=0} 19:26:10.934448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6623): Launched 19:26:11.230432 run osmo-hlr_10.42.42.2(pid=6624): Launched 19:26:11.342379 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:11.853403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6626): Launched 19:26:12.150640 run osmo-stp_10.42.42.5(pid=6627): Launched 19:26:12.264328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:12.782267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6629): Launched 19:26:12.896266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:13.150303 run patchelf(pid=6630): Launched 19:26:13.317460 run osmo-stp_10.42.42.5(pid=6627): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6627)] 19:26:13.444876 run osmo-stp_10.42.42.5(pid=6627): stdout: | (launched: 2022-12-09_19:26:12.096219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:13.573975 run osmo-stp_10.42.42.5(pid=6627): stderr: | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192612262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:13.703339 run osmo-stp_10.42.42.5(pid=6627): stdout: | (launched: 2022-12-09_19:26:12.096219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:13.826541 run osmo-stp_10.42.42.5(pid=6627): stderr: | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192612262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192612262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192612263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:13.972827 run patchelf(pid=6630): Terminating (SIGINT) 19:26:14.141254 run patchelf(pid=6630): Terminated: ok {rc=0} 19:26:14.262665 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6627): Process ended prematurely: osmo-stp_10.42.42.5(pid=6627) [trial-2363↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6627)] [trial-2363↪gprs:trx-lms↪iperf3m4.py:8] 19:26:14.272036 tst iperf3m4.py:8: Test FAILED (10.5 sec) 19:26:14.298977 run osmo-hlr_10.42.42.2(pid=6624): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6624)] 19:26:14.345545 run osmo-hlr_10.42.42.2(pid=6624): stdout: | (launched: 2022-12-09_19:26:11.176390) 19:26:14.393620 run osmo-hlr_10.42.42.2(pid=6624): stderr: | [0;m[1;31m20221209192611346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192611346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192611346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192611347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192611347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192611347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192611358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192611367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192611367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192611368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:14.442495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6613): Terminating (SIGTERM) 19:26:14.481337 run iperf3-srv_10.42.42.10(pid=6614): Terminating (SIGTERM) 19:26:14.520154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6615): Terminating (SIGTERM) 19:26:14.558680 run iperf3-srv_10.42.42.10(pid=6616): Terminating (SIGTERM) 19:26:14.597424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6617): Terminating (SIGTERM) 19:26:14.636767 run iperf3-srv_10.42.42.10(pid=6618): Terminating (SIGTERM) 19:26:14.675578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminating (SIGTERM) 19:26:14.714290 run iperf3-srv_10.42.42.10(pid=6620): Terminating (SIGTERM) 19:26:14.752759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6623): Terminating (SIGTERM) 19:26:14.791492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6626): Terminating (SIGTERM) 19:26:14.830203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6629): Terminating (SIGTERM) 19:26:14.869121 --- ParallelTerminationStrategy: PID 6613 died... 19:26:14.887644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6613): Terminated: ok {rc=0} 19:26:14.930631 --- ParallelTerminationStrategy: PID 6614 died... 19:26:14.948799 run iperf3-srv_10.42.42.10(pid=6614): Terminated {rc=256} 19:26:14.991249 --- ParallelTerminationStrategy: PID 6615 died... 19:26:15.009360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6615): Terminated: ok {rc=0} 19:26:15.051936 --- ParallelTerminationStrategy: PID 6616 died... 19:26:15.070031 run iperf3-srv_10.42.42.10(pid=6616): Terminated {rc=256} 19:26:15.113085 --- ParallelTerminationStrategy: PID 6617 died... 19:26:15.131185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6617): Terminated: ok {rc=0} 19:26:15.173628 --- ParallelTerminationStrategy: PID 6618 died... 19:26:15.191679 run iperf3-srv_10.42.42.10(pid=6618): Terminated {rc=256} 19:26:15.234908 --- ParallelTerminationStrategy: PID 6619 died... 19:26:15.253086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminated: ok {rc=0} 19:26:15.295631 --- ParallelTerminationStrategy: PID 6620 died... 19:26:15.313813 run iperf3-srv_10.42.42.10(pid=6620): Terminated {rc=256} 19:26:15.356385 --- ParallelTerminationStrategy: PID 6623 died... 19:26:15.374679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6623): Terminated: ok {rc=0} 19:26:15.417274 --- ParallelTerminationStrategy: PID 6626 died... 19:26:15.435330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6626): Terminated: ok {rc=0} 19:26:15.478218 --- ParallelTerminationStrategy: PID 6629 died... 19:26:15.496514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6629): Terminated: ok {rc=0} 19:26:15.579889 bus /gobi_4: Setting Powered False 19:26:16.675651 bus /gobi_4: Setting Powered False 19:26:17.788895 bus /gobi_1: Setting Powered False 19:26:18.883407 bus /gobi_1: Setting Powered False 19:26:19.996570 bus /gobi_0: Setting Powered False 19:26:21.093231 bus /gobi_0: Setting Powered False 19:26:22.210747 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms ping.py ---------------------------------------------- 19:26:23.314425 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.326154 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:26:23.377695 tst ping.py: using LAC 23196 19:26:23.495042 tst ping.py: using RAC 246 19:26:23.612230 tst ping.py: using CellId 23196 19:26:23.730119 tst ping.py: using BVCI 23197 19:26:23.837640 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.848142 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.858639 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.868862 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.878939 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.889116 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.899316 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:23.909537 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:24.023024 tst ping.py:19: start network... 19:26:24.221490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:24.681303 run create_hlr_db(pid=6631): Launched 19:26:24.801402 bus /gobi_6: Setting Powered False 19:26:25.861120 run create_hlr_db(pid=6631): Terminated: ok {rc=0} 19:26:26.275261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6633): Launched 19:26:26.572347 run osmo-hlr_10.42.42.2(pid=6634): Launched 19:26:26.685532 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:27.215754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6636): Launched 19:26:27.512740 run osmo-stp_10.42.42.5(pid=6637): Launched 19:26:27.625817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:28.137545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6639): Launched 19:26:28.250913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:28.501755 run patchelf(pid=6640): Launched 19:26:28.667750 run osmo-stp_10.42.42.5(pid=6637): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6637)] 19:26:28.793653 run osmo-stp_10.42.42.5(pid=6637): stdout: | (launched: 2022-12-09_19:26:27.457349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:28.921119 run osmo-stp_10.42.42.5(pid=6637): stderr: | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192627630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:29.048694 run osmo-stp_10.42.42.5(pid=6637): stdout: | (launched: 2022-12-09_19:26:27.457349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:29.171159 run osmo-stp_10.42.42.5(pid=6637): stderr: | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192627630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192627630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192627631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:29.315788 run patchelf(pid=6640): Terminating (SIGINT) 19:26:29.482014 run patchelf(pid=6640): Terminated: ok {rc=0} 19:26:29.602223 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6637): Process ended prematurely: osmo-stp_10.42.42.5(pid=6637) [trial-2363↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6637)] [trial-2363↪gprs:trx-lms↪ping.py:22] 19:26:29.611217 tst ping.py:22: Test FAILED (6.3 sec) 19:26:29.637734 run osmo-hlr_10.42.42.2(pid=6634): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6634)] 19:26:29.684747 run osmo-hlr_10.42.42.2(pid=6634): stdout: | (launched: 2022-12-09_19:26:26.517646) 19:26:29.733457 run osmo-hlr_10.42.42.2(pid=6634): stderr: | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192626694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192626706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192626715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192626715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192626715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:29.782429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6633): Terminating (SIGTERM) 19:26:29.821709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6636): Terminating (SIGTERM) 19:26:29.860764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6639): Terminating (SIGTERM) 19:26:29.899884 --- ParallelTerminationStrategy: PID 6633 died... 19:26:29.918723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6633): Terminated: ok {rc=0} 19:26:29.962093 --- ParallelTerminationStrategy: PID 6636 died... 19:26:29.980455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6636): Terminated: ok {rc=0} 19:26:30.023488 --- ParallelTerminationStrategy: PID 6639 died... 19:26:30.042015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6639): Terminated: ok {rc=0} 19:26:30.126542 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 19:26:31.213583 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.226423 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:26:31.283299 tst ping_idle_ping.py: using LAC 23197 19:26:31.439545 tst ping_idle_ping.py: using RAC 247 19:26:31.601931 tst ping_idle_ping.py: using CellId 23197 19:26:31.750593 tst ping_idle_ping.py: using BVCI 23198 19:26:31.875741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.888264 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.900461 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.914096 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.926276 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.939100 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.952153 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:26:31.964806 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:26:32.103569 tst ping_idle_ping.py:24: start network... 19:26:32.305788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:32.773144 run create_hlr_db(pid=6641): Launched 19:26:32.895002 bus /gobi_6: Setting Powered False 19:26:33.954798 run create_hlr_db(pid=6641): Terminated: ok {rc=0} 19:26:34.391176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Launched 19:26:34.712451 run osmo-hlr_10.42.42.2(pid=6644): Launched 19:26:34.834696 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:35.382608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Launched 19:26:35.702710 run osmo-stp_10.42.42.5(pid=6647): Launched 19:26:35.825222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:36.375238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Launched 19:26:36.498232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:36.766613 run patchelf(pid=6650): Launched 19:26:36.945427 run osmo-stp_10.42.42.5(pid=6647): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] 19:26:37.080402 run osmo-stp_10.42.42.5(pid=6647): stdout: | (launched: 2022-12-09_19:26:35.644579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:37.216628 run osmo-stp_10.42.42.5(pid=6647): stderr: | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192635837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:37.353744 run osmo-stp_10.42.42.5(pid=6647): stdout: | (launched: 2022-12-09_19:26:35.644579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:37.484432 run osmo-stp_10.42.42.5(pid=6647): stderr: | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192635836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192635837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192635837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:37.639693 run patchelf(pid=6650): Terminating (SIGINT) 19:26:37.817392 run patchelf(pid=6650): Terminated: ok {rc=0} 19:26:37.945448 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6647): Process ended prematurely: osmo-stp_10.42.42.5(pid=6647) [trial-2363↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] [trial-2363↪gprs:trx-lms↪ping_idle_ping.py:27] 19:26:37.955388 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:26:37.983884 run osmo-hlr_10.42.42.2(pid=6644): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6644)] 19:26:38.033853 run osmo-hlr_10.42.42.2(pid=6644): stdout: | (launched: 2022-12-09_19:26:34.654362) 19:26:38.085370 run osmo-hlr_10.42.42.2(pid=6644): stderr: | [0;m[1;31m20221209192634854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192634854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192634855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192634855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192634855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192634855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192634868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192634878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192634878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192634878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:38.136838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Terminating (SIGTERM) 19:26:38.178383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Terminating (SIGTERM) 19:26:38.219973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Terminating (SIGTERM) 19:26:38.261922 --- ParallelTerminationStrategy: PID 6643 died... 19:26:38.281652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Terminated: ok {rc=0} 19:26:38.328208 --- ParallelTerminationStrategy: PID 6646 died... 19:26:38.347475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Terminated: ok {rc=0} 19:26:38.394009 --- ParallelTerminationStrategy: PID 6649 died... 19:26:38.413435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Terminated: ok {rc=0} 19:26:38.500918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 19:26:39.800763 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:26:39.806728 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:26:39.841493 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:26:39.880895 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:26:39.969593 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:26:40.003842 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:26:40.042777 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:26:40.636733 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:26:40.690226 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:40.701630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:26:40.753247 tst cs_paging_gprs_active.py: using LAC 23198 19:26:40.881318 tst cs_paging_gprs_active.py: using RAC 248 19:26:41.008264 tst cs_paging_gprs_active.py: using CellId 23198 19:26:41.135281 tst cs_paging_gprs_active.py: using BVCI 23199 19:26:41.253659 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.264827 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.275788 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.287088 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.298964 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.310542 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.322230 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.333787 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:41.345341 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:26:41.464008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:26:41.579179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:26:41.783989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:42.089460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6654): Launched 19:26:42.353153 run iperf3-srv_10.42.42.10(pid=6655): Launched 19:26:42.466332 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:26:42.670723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:42.976037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6656): Launched 19:26:43.240502 run iperf3-srv_10.42.42.10(pid=6657): Launched 19:26:43.354070 tst cs_paging_gprs_active.py:38: start network... 19:26:43.556732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:44.026258 run create_hlr_db(pid=6658): Launched 19:26:44.150974 bus /gobi_6: Setting Powered False 19:26:45.210960 run create_hlr_db(pid=6658): Terminated: ok {rc=0} 19:26:45.652190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6660): Launched 19:26:46.001177 run osmo-hlr_10.42.42.2(pid=6661): Launched 19:26:46.235472 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:46.976597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6663): Launched 19:26:47.314757 run osmo-stp_10.42.42.5(pid=6664): Launched 19:26:47.440644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:48.000842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6666): Launched 19:26:48.126730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:48.400943 run patchelf(pid=6667): Launched 19:26:48.582403 run osmo-stp_10.42.42.5(pid=6664): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6664)] 19:26:48.720150 run osmo-stp_10.42.42.5(pid=6664): stdout: | (launched: 2022-12-09_19:26:47.255756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:48.859130 run osmo-stp_10.42.42.5(pid=6664): stderr: | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192647445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:48.998181 run osmo-stp_10.42.42.5(pid=6664): stdout: | (launched: 2022-12-09_19:26:47.255756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:49.131974 run osmo-stp_10.42.42.5(pid=6664): stderr: | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192647444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192647445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192647445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:49.289912 run patchelf(pid=6667): Terminating (SIGINT) 19:26:49.471798 run patchelf(pid=6667): Terminated: ok {rc=0} 19:26:49.602929 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6664): Process ended prematurely: osmo-stp_10.42.42.5(pid=6664) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6664)] [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:26:49.613356 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 19:26:49.642741 run osmo-hlr_10.42.42.2(pid=6661): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6661)] 19:26:49.692188 run osmo-hlr_10.42.42.2(pid=6661): stdout: | (launched: 2022-12-09_19:26:45.943175) 19:26:49.743498 run osmo-hlr_10.42.42.2(pid=6661): stderr: | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192646288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192646313 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192646325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192646325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192646326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:49.795059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6654): Terminating (SIGTERM) 19:26:49.837198 run iperf3-srv_10.42.42.10(pid=6655): Terminating (SIGTERM) 19:26:49.878490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6656): Terminating (SIGTERM) 19:26:49.919937 run iperf3-srv_10.42.42.10(pid=6657): Terminating (SIGTERM) 19:26:49.961465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6660): Terminating (SIGTERM) 19:26:50.002941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6663): Terminating (SIGTERM) 19:26:50.044354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6666): Terminating (SIGTERM) 19:26:50.086424 --- ParallelTerminationStrategy: PID 6654 died... 19:26:50.106121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6654): Terminated: ok {rc=0} 19:26:50.152431 --- ParallelTerminationStrategy: PID 6655 died... 19:26:50.171733 run iperf3-srv_10.42.42.10(pid=6655): Terminated {rc=256} 19:26:50.217926 --- ParallelTerminationStrategy: PID 6656 died... 19:26:50.237321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6656): Terminated: ok {rc=0} 19:26:50.283322 --- ParallelTerminationStrategy: PID 6657 died... 19:26:50.302611 run iperf3-srv_10.42.42.10(pid=6657): Terminated {rc=256} 19:26:50.348505 --- ParallelTerminationStrategy: PID 6660 died... 19:26:50.367989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6660): Terminated: ok {rc=0} 19:26:50.414145 --- ParallelTerminationStrategy: PID 6663 died... 19:26:50.433520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6663): Terminated: ok {rc=0} 19:26:50.479755 --- ParallelTerminationStrategy: PID 6666 died... 19:26:50.499112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6666): Terminated: ok {rc=0} 19:26:50.585883 bus /gobi_0: Setting Powered False 19:26:51.683734 bus /gobi_0: Setting Powered False 19:26:52.797990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:26:53.940387 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:53.951847 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:26:54.001970 tst iperf3.py: using LAC 23199 19:26:54.130779 tst iperf3.py: using RAC 249 19:26:54.258959 tst iperf3.py: using CellId 23199 19:26:54.386780 tst iperf3.py: using BVCI 23200 19:26:54.503900 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.515460 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.526661 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.538202 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.549511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.560933 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.572385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.583658 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:26:54.595018 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:26:54.715534 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:26:54.935558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:55.261719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6668): Launched 19:26:55.544756 run iperf3-srv_10.42.42.10(pid=6669): Launched 19:26:55.666621 tst iperf3.py:8: start network... 19:26:55.885816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:56.387043 run create_hlr_db(pid=6670): Launched 19:26:56.510797 bus /gobi_6: Setting Powered False 19:26:57.574507 run create_hlr_db(pid=6670): Terminated: ok {rc=0} 19:26:58.010248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Launched 19:26:58.314513 run osmo-hlr_10.42.42.2(pid=6673): Launched 19:26:58.431843 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:58.953652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Launched 19:26:59.254458 run osmo-stp_10.42.42.5(pid=6676): Launched 19:26:59.369271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:59.888558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6678): Launched 19:27:00.003794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:00.259378 run patchelf(pid=6679): Launched 19:27:00.427415 run osmo-stp_10.42.42.5(pid=6676): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] 19:27:00.555259 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-09_19:26:59.198879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:00.684805 run osmo-stp_10.42.42.5(pid=6676): stderr: | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192659369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192659369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192659370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192659370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:00.815296 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-09_19:26:59.198879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:00.968261 run osmo-stp_10.42.42.5(pid=6676): stderr: | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192659368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192659369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192659369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192659370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192659370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:01.117986 run patchelf(pid=6679): Terminating (SIGINT) 19:27:01.290328 run patchelf(pid=6679): Terminated: ok {rc=0} 19:27:01.414717 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 19:27:01.425408 tst iperf3.py:8: Test FAILED (7.5 sec) 19:27:01.453484 run osmo-hlr_10.42.42.2(pid=6673): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6673)] 19:27:01.501851 run osmo-hlr_10.42.42.2(pid=6673): stdout: | (launched: 2022-12-09_19:26:58.258998) 19:27:01.551840 run osmo-hlr_10.42.42.2(pid=6673): stderr: | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192658436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192658448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192658459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192658459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192658459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:01.602556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6668): Terminating (SIGTERM) 19:27:01.643376 run iperf3-srv_10.42.42.10(pid=6669): Terminating (SIGTERM) 19:27:01.686611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminating (SIGTERM) 19:27:01.727502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminating (SIGTERM) 19:27:01.768199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6678): Terminating (SIGTERM) 19:27:01.810479 --- ParallelTerminationStrategy: PID 6668 died... 19:27:01.829727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6668): Terminated: ok {rc=0} 19:27:01.874417 --- ParallelTerminationStrategy: PID 6669 died... 19:27:01.893482 run iperf3-srv_10.42.42.10(pid=6669): Terminated {rc=256} 19:27:01.937549 --- ParallelTerminationStrategy: PID 6672 died... 19:27:01.956505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminated: ok {rc=0} 19:27:02.000786 --- ParallelTerminationStrategy: PID 6675 died... 19:27:02.019744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminated: ok {rc=0} 19:27:02.063978 --- ParallelTerminationStrategy: PID 6678 died... 19:27:02.082718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6678): Terminated: ok {rc=0} 19:27:02.166613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:27:03.316055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.328129 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:27:03.379443 tst iperf3m4.py: using LAC 23200 19:27:03.504519 tst iperf3m4.py: using RAC 250 19:27:03.629336 tst iperf3m4.py: using CellId 23200 19:27:03.754203 tst iperf3m4.py: using BVCI 23201 19:27:03.872410 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.883920 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.895181 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.906848 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.918318 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.929779 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.941446 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.952893 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:03.964557 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:04.084199 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:04.203501 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:04.322378 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:04.439220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:27:04.643098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:04.948091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Launched 19:27:05.211233 run iperf3-srv_10.42.42.10(pid=6681): Launched 19:27:05.324894 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:27:05.528603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:05.833203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6682): Launched 19:27:06.097073 run iperf3-srv_10.42.42.10(pid=6683): Launched 19:27:06.209922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:27:06.412564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:06.716487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6684): Launched 19:27:06.980861 run iperf3-srv_10.42.42.10(pid=6685): Launched 19:27:07.093766 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:27:07.296644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:07.601130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Launched 19:27:07.863931 run iperf3-srv_10.42.42.10(pid=6687): Launched 19:27:07.976779 tst iperf3m4.py:8: start network... 19:27:08.179891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:08.649485 run create_hlr_db(pid=6688): Launched 19:27:08.774503 bus /gobi_6: Setting Powered False 19:27:09.835291 run create_hlr_db(pid=6688): Terminated: ok {rc=0} 19:27:10.278771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6690): Launched 19:27:10.605139 run osmo-hlr_10.42.42.2(pid=6691): Launched 19:27:10.729942 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:11.291124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6693): Launched 19:27:11.615202 run osmo-stp_10.42.42.5(pid=6694): Launched 19:27:11.740360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:12.302097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6696): Launched 19:27:12.423233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:12.679441 run patchelf(pid=6697): Launched 19:27:12.847380 run osmo-stp_10.42.42.5(pid=6694): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6694)] 19:27:12.976016 run osmo-stp_10.42.42.5(pid=6694): stdout: | (launched: 2022-12-09_19:27:11.556351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:13.106090 run osmo-stp_10.42.42.5(pid=6694): stderr: | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192711746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:13.235859 run osmo-stp_10.42.42.5(pid=6694): stdout: | (launched: 2022-12-09_19:27:11.556351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:13.359719 run osmo-stp_10.42.42.5(pid=6694): stderr: | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192711745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192711746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192711746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:13.507663 run patchelf(pid=6697): Terminating (SIGINT) 19:27:13.676458 run patchelf(pid=6697): Terminated: ok {rc=0} 19:27:13.798308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6694): Process ended prematurely: osmo-stp_10.42.42.5(pid=6694) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6694)] [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 19:27:13.807817 tst iperf3m4.py:8: Test FAILED (10.5 sec) 19:27:13.834702 run osmo-hlr_10.42.42.2(pid=6691): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6691)] 19:27:13.881345 run osmo-hlr_10.42.42.2(pid=6691): stdout: | (launched: 2022-12-09_19:27:10.545914) 19:27:13.929487 run osmo-hlr_10.42.42.2(pid=6691): stderr: | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192710741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192710755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192710765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192710765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192710765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:13.978013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Terminating (SIGTERM) 19:27:14.017020 run iperf3-srv_10.42.42.10(pid=6681): Terminating (SIGTERM) 19:27:14.055863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6682): Terminating (SIGTERM) 19:27:14.094870 run iperf3-srv_10.42.42.10(pid=6683): Terminating (SIGTERM) 19:27:14.133621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6684): Terminating (SIGTERM) 19:27:14.172582 run iperf3-srv_10.42.42.10(pid=6685): Terminating (SIGTERM) 19:27:14.211268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Terminating (SIGTERM) 19:27:14.250349 run iperf3-srv_10.42.42.10(pid=6687): Terminating (SIGTERM) 19:27:14.289203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6690): Terminating (SIGTERM) 19:27:14.328205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6693): Terminating (SIGTERM) 19:27:14.367085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6696): Terminating (SIGTERM) 19:27:14.406334 --- ParallelTerminationStrategy: PID 6680 died... 19:27:14.425164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Terminated: ok {rc=0} 19:27:14.468346 --- ParallelTerminationStrategy: PID 6681 died... 19:27:14.486689 run iperf3-srv_10.42.42.10(pid=6681): Terminated {rc=256} 19:27:14.529489 --- ParallelTerminationStrategy: PID 6682 died... 19:27:14.547543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6682): Terminated: ok {rc=0} 19:27:14.591411 --- ParallelTerminationStrategy: PID 6683 died... 19:27:14.609767 run iperf3-srv_10.42.42.10(pid=6683): Terminated {rc=256} 19:27:14.653142 --- ParallelTerminationStrategy: PID 6684 died... 19:27:14.671462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6684): Terminated: ok {rc=0} 19:27:14.715303 --- ParallelTerminationStrategy: PID 6685 died... 19:27:14.733805 run iperf3-srv_10.42.42.10(pid=6685): Terminated {rc=256} 19:27:14.777120 --- ParallelTerminationStrategy: PID 6686 died... 19:27:14.795369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Terminated: ok {rc=0} 19:27:14.838924 --- ParallelTerminationStrategy: PID 6687 died... 19:27:14.857453 run iperf3-srv_10.42.42.10(pid=6687): Terminated {rc=256} 19:27:14.901272 --- ParallelTerminationStrategy: PID 6690 died... 19:27:14.919605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6690): Terminated: ok {rc=0} 19:27:14.963129 --- ParallelTerminationStrategy: PID 6693 died... 19:27:14.981554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6693): Terminated: ok {rc=0} 19:27:15.025247 --- ParallelTerminationStrategy: PID 6696 died... 19:27:15.043659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6696): Terminated: ok {rc=0} 19:27:15.129405 bus /gobi_4: Setting Powered False 19:27:16.243958 bus /gobi_4: Setting Powered False 19:27:17.372867 bus /gobi_1: Setting Powered False 19:27:18.470526 bus /gobi_1: Setting Powered False 19:27:19.585433 bus /gobi_0: Setting Powered False 19:27:20.685048 bus /gobi_0: Setting Powered False 19:27:21.802884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 19:27:22.906205 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:22.918625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:27:22.971063 tst ping.py: using LAC 23201 19:27:23.097030 tst ping.py: using RAC 251 19:27:23.221756 tst ping.py: using CellId 23201 19:27:23.340584 tst ping.py: using BVCI 23202 19:27:23.448511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.459486 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.470247 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.481707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.492749 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.503811 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.515436 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:23.526903 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:23.645233 tst ping.py:19: start network... 19:27:23.860563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:24.353410 run create_hlr_db(pid=6698): Launched 19:27:24.475795 bus /gobi_6: Setting Powered False 19:27:25.538230 run create_hlr_db(pid=6698): Terminated: ok {rc=0} 19:27:25.964341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6700): Launched 19:27:26.262605 run osmo-hlr_10.42.42.2(pid=6701): Launched 19:27:26.377869 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:26.896849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6703): Launched 19:27:27.195358 run osmo-stp_10.42.42.5(pid=6704): Launched 19:27:27.310049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:27.822389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6706): Launched 19:27:27.937440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:28.188848 run patchelf(pid=6707): Launched 19:27:28.354128 run osmo-stp_10.42.42.5(pid=6704): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6704)] 19:27:28.479530 run osmo-stp_10.42.42.5(pid=6704): stdout: | (launched: 2022-12-09_19:27:27.139852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:28.606555 run osmo-stp_10.42.42.5(pid=6704): stderr: | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192727310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:28.733389 run osmo-stp_10.42.42.5(pid=6704): stdout: | (launched: 2022-12-09_19:27:27.139852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:28.855253 run osmo-stp_10.42.42.5(pid=6704): stderr: | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192727309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192727310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192727310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:28.999151 run patchelf(pid=6707): Terminating (SIGINT) 19:27:29.166361 run patchelf(pid=6707): Terminated: ok {rc=0} 19:27:29.286393 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6704): Process ended prematurely: osmo-stp_10.42.42.5(pid=6704) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6704)] [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 19:27:29.295504 tst ping.py:22: Test FAILED (6.4 sec) 19:27:29.321913 run osmo-hlr_10.42.42.2(pid=6701): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6701)] 19:27:29.368700 run osmo-hlr_10.42.42.2(pid=6701): stdout: | (launched: 2022-12-09_19:27:26.207909) 19:27:29.417171 run osmo-hlr_10.42.42.2(pid=6701): stderr: | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192726382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192726395 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192726404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192726404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192726404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:29.465966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6700): Terminating (SIGTERM) 19:27:29.505094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6703): Terminating (SIGTERM) 19:27:29.544242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6706): Terminating (SIGTERM) 19:27:29.583872 --- ParallelTerminationStrategy: PID 6700 died... 19:27:29.602719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6700): Terminated: ok {rc=0} 19:27:29.646118 --- ParallelTerminationStrategy: PID 6703 died... 19:27:29.664299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6703): Terminated: ok {rc=0} 19:27:29.707432 --- ParallelTerminationStrategy: PID 6706 died... 19:27:29.725873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6706): Terminated: ok {rc=0} 19:27:29.809584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:27:30.913500 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:30.934174 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:27:31.003982 tst ping_idle_ping.py: using LAC 23202 19:27:31.134645 tst ping_idle_ping.py: using RAC 252 19:27:31.254417 tst ping_idle_ping.py: using CellId 23202 19:27:31.374103 tst ping_idle_ping.py: using BVCI 23203 19:27:31.498275 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.510338 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.522585 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.535457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.547497 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.560928 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.573785 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:27:31.586394 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:27:31.710254 tst ping_idle_ping.py:24: start network... 19:27:31.932915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:32.438058 run create_hlr_db(pid=6708): Launched 19:27:32.562895 bus /gobi_6: Setting Powered False 19:27:33.627333 run create_hlr_db(pid=6708): Terminated: ok {rc=0} 19:27:34.072767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6710): Launched 19:27:34.392804 run osmo-hlr_10.42.42.2(pid=6711): Launched 19:27:34.514829 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:35.063756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6713): Launched 19:27:35.385344 run osmo-stp_10.42.42.5(pid=6714): Launched 19:27:35.509152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:36.053142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6717): Launched 19:27:36.167760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:36.419941 run patchelf(pid=6718): Launched 19:27:36.585426 run osmo-stp_10.42.42.5(pid=6714): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6714)] 19:27:36.712090 run osmo-stp_10.42.42.5(pid=6714): stdout: | (launched: 2022-12-09_19:27:35.327084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:36.841358 run osmo-stp_10.42.42.5(pid=6714): stderr: | [0;m[38;5;43m20221209192735518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192735519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192735519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192735519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:36.970010 run osmo-stp_10.42.42.5(pid=6714): stdout: | (launched: 2022-12-09_19:27:35.327084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:37.094075 run osmo-stp_10.42.42.5(pid=6714): stderr: | [0;m[38;5;43m20221209192735518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192735519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192735519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192735519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192735520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:37.239533 run patchelf(pid=6718): Terminating (SIGINT) 19:27:37.406432 run patchelf(pid=6718): Terminated: ok {rc=0} 19:27:37.526550 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6714): Process ended prematurely: osmo-stp_10.42.42.5(pid=6714) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6714)] [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 19:27:37.535428 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:27:37.561801 run osmo-hlr_10.42.42.2(pid=6711): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6711)] 19:27:37.608445 run osmo-hlr_10.42.42.2(pid=6711): stdout: | (launched: 2022-12-09_19:27:34.334122) 19:27:37.656686 run osmo-hlr_10.42.42.2(pid=6711): stderr: | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192734533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192734545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192734553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192734553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192734553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:37.705588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6710): Terminating (SIGTERM) 19:27:37.744198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6713): Terminating (SIGTERM) 19:27:37.782953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6717): Terminating (SIGTERM) 19:27:37.821970 --- ParallelTerminationStrategy: PID 6710 died... 19:27:37.840486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6710): Terminated: ok {rc=0} 19:27:37.884056 --- ParallelTerminationStrategy: PID 6713 died... 19:27:37.902350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6713): Terminated: ok {rc=0} 19:27:37.945277 --- ParallelTerminationStrategy: PID 6717 died... 19:27:37.963567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6717): Terminated: ok {rc=0} 19:27:38.048011 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:27:39.354314 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:39.361311 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:27:39.396134 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:27:39.435387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:27:39.523181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:27:39.555997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:27:39.593851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:27:40.186974 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:27:40.236820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.247791 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:27:40.314631 tst cs_paging_gprs_active.py: using LAC 23203 19:27:40.432886 tst cs_paging_gprs_active.py: using RAC 253 19:27:40.553617 tst cs_paging_gprs_active.py: using CellId 23203 19:27:40.673292 tst cs_paging_gprs_active.py: using BVCI 23204 19:27:40.785111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.795908 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.806603 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.817578 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.828361 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.839231 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.850323 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.861114 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:40.872099 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:27:40.990066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:27:41.105836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:27:41.312164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:41.618767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6722): Launched 19:27:41.883906 run iperf3-srv_10.42.42.10(pid=6723): Launched 19:27:41.997906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:27:42.202382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:42.509048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6724): Launched 19:27:42.793240 run iperf3-srv_10.42.42.10(pid=6725): Launched 19:27:42.916272 tst cs_paging_gprs_active.py:38: start network... 19:27:43.136898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:43.641429 run create_hlr_db(pid=6726): Launched 19:27:43.767174 bus /gobi_6: Setting Powered False 19:27:44.831579 run create_hlr_db(pid=6726): Terminated: ok {rc=0} 19:27:45.266427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6728): Launched 19:27:45.570266 run osmo-hlr_10.42.42.2(pid=6729): Launched 19:27:45.685828 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:46.257129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6731): Launched 19:27:46.631203 run osmo-stp_10.42.42.5(pid=6732): Launched 19:27:46.890966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:47.562302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6734): Launched 19:27:47.678115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:47.941475 run patchelf(pid=6735): Launched 19:27:48.110516 run osmo-stp_10.42.42.5(pid=6732): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6732)] 19:27:48.239564 run osmo-stp_10.42.42.5(pid=6732): stdout: | (launched: 2022-12-09_19:27:46.570408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:48.369979 run osmo-stp_10.42.42.5(pid=6732): stderr: | [0;m[38;5;43m20221209192746813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192746814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192746814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192746819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:48.500574 run osmo-stp_10.42.42.5(pid=6732): stdout: | (launched: 2022-12-09_19:27:46.570408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:48.625312 run osmo-stp_10.42.42.5(pid=6732): stderr: | [0;m[38;5;43m20221209192746813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192746814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192746814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192746819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192746820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:48.772789 run patchelf(pid=6735): Terminating (SIGINT) 19:27:48.943335 run patchelf(pid=6735): Terminated: ok {rc=0} 19:27:49.065986 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6732): Process ended prematurely: osmo-stp_10.42.42.5(pid=6732) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6732)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:27:49.075475 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:27:49.102364 run osmo-hlr_10.42.42.2(pid=6729): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6729)] 19:27:49.149119 run osmo-hlr_10.42.42.2(pid=6729): stdout: | (launched: 2022-12-09_19:27:45.514398) 19:27:49.197849 run osmo-hlr_10.42.42.2(pid=6729): stderr: | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192745690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192745703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192745713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192745714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192745714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:49.246703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6722): Terminating (SIGTERM) 19:27:49.285839 run iperf3-srv_10.42.42.10(pid=6723): Terminating (SIGTERM) 19:27:49.326501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6724): Terminating (SIGTERM) 19:27:49.365756 run iperf3-srv_10.42.42.10(pid=6725): Terminating (SIGTERM) 19:27:49.404847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6728): Terminating (SIGTERM) 19:27:49.443838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6731): Terminating (SIGTERM) 19:27:49.483072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6734): Terminating (SIGTERM) 19:27:49.522716 --- ParallelTerminationStrategy: PID 6722 died... 19:27:49.541766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6722): Terminated: ok {rc=0} 19:27:49.585371 --- ParallelTerminationStrategy: PID 6723 died... 19:27:49.603904 run iperf3-srv_10.42.42.10(pid=6723): Terminated {rc=256} 19:27:49.647251 --- ParallelTerminationStrategy: PID 6724 died... 19:27:49.665813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6724): Terminated: ok {rc=0} 19:27:49.709455 --- ParallelTerminationStrategy: PID 6725 died... 19:27:49.727904 run iperf3-srv_10.42.42.10(pid=6725): Terminated {rc=256} 19:27:49.771223 --- ParallelTerminationStrategy: PID 6728 died... 19:27:49.790091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6728): Terminated: ok {rc=0} 19:27:49.833823 --- ParallelTerminationStrategy: PID 6731 died... 19:27:49.852266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6731): Terminated: ok {rc=0} 19:27:49.895668 --- ParallelTerminationStrategy: PID 6734 died... 19:27:49.914268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6734): Terminated: ok {rc=0} 19:27:49.999157 bus /gobi_0: Setting Powered False 19:27:51.099013 bus /gobi_0: Setting Powered False 19:27:52.210610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:27:53.358929 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.371085 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:27:53.443884 tst iperf3.py: using LAC 23204 19:27:53.571607 tst iperf3.py: using RAC 254 19:27:53.700225 tst iperf3.py: using CellId 23204 19:27:53.819977 tst iperf3.py: using BVCI 23205 19:27:53.931107 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.942112 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.952627 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.963353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.974130 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.984578 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:53.995266 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:54.005739 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:27:54.016284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:27:54.134721 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:27:54.355049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:54.681045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6736): Launched 19:27:54.963413 run iperf3-srv_10.42.42.10(pid=6737): Launched 19:27:55.084812 tst iperf3.py:8: start network... 19:27:55.304784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:55.807575 run create_hlr_db(pid=6738): Launched 19:27:55.931914 bus /gobi_6: Setting Powered False 19:27:56.995393 run create_hlr_db(pid=6738): Terminated: ok {rc=0} 19:27:57.429747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6740): Launched 19:27:57.735618 run osmo-hlr_10.42.42.2(pid=6741): Launched 19:27:57.850384 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:58.373082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6743): Launched 19:27:58.676132 run osmo-stp_10.42.42.5(pid=6744): Launched 19:27:58.791206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:59.315455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6746): Launched 19:27:59.430932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:59.686857 run patchelf(pid=6747): Launched 19:27:59.856613 run osmo-stp_10.42.42.5(pid=6744): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6744)] 19:27:59.984437 run osmo-stp_10.42.42.5(pid=6744): stdout: | (launched: 2022-12-09_19:27:58.620030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:00.114239 run osmo-stp_10.42.42.5(pid=6744): stderr: | [0;m[38;5;43m20221209192758792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192758792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192758793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192758794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:00.244156 run osmo-stp_10.42.42.5(pid=6744): stdout: | (launched: 2022-12-09_19:27:58.620030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:00.368198 run osmo-stp_10.42.42.5(pid=6744): stderr: | [0;m[38;5;43m20221209192758792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192758792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192758793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192758794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192758795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:00.515164 run patchelf(pid=6747): Terminating (SIGINT) 19:28:00.684162 run patchelf(pid=6747): Terminated: ok {rc=0} 19:28:00.806859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6744): Process ended prematurely: osmo-stp_10.42.42.5(pid=6744) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6744)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 19:28:00.816676 tst iperf3.py:8: Test FAILED (7.5 sec) 19:28:00.844560 run osmo-hlr_10.42.42.2(pid=6741): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6741)] 19:28:00.910744 run osmo-hlr_10.42.42.2(pid=6741): stdout: | (launched: 2022-12-09_19:27:57.679987) 19:28:00.965132 run osmo-hlr_10.42.42.2(pid=6741): stderr: | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192757859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192757871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192757880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192757880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192757880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:01.021246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6736): Terminating (SIGTERM) 19:28:01.065956 run iperf3-srv_10.42.42.10(pid=6737): Terminating (SIGTERM) 19:28:01.109808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6740): Terminating (SIGTERM) 19:28:01.154461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6743): Terminating (SIGTERM) 19:28:01.201315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6746): Terminating (SIGTERM) 19:28:01.247287 --- ParallelTerminationStrategy: PID 6736 died... 19:28:01.267989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6736): Terminated: ok {rc=0} 19:28:01.318537 --- ParallelTerminationStrategy: PID 6737 died... 19:28:01.339484 run iperf3-srv_10.42.42.10(pid=6737): Terminated {rc=256} 19:28:01.388787 --- ParallelTerminationStrategy: PID 6740 died... 19:28:01.410101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6740): Terminated: ok {rc=0} 19:28:01.459231 --- ParallelTerminationStrategy: PID 6743 died... 19:28:01.479523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6743): Terminated: ok {rc=0} 19:28:01.529389 --- ParallelTerminationStrategy: PID 6746 died... 19:28:01.550122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6746): Terminated: ok {rc=0} 19:28:01.649040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:28:02.815046 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:02.827289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:28:02.903435 tst iperf3m4.py: using LAC 23205 19:28:03.028206 tst iperf3m4.py: using RAC 255 19:28:03.152894 tst iperf3m4.py: using CellId 23205 19:28:03.285391 tst iperf3m4.py: using BVCI 23206 19:28:03.398088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.409332 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.419984 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.431182 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.442429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.453749 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.465288 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.476388 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:03.487658 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:03.604312 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:03.726675 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:03.846624 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:03.965499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:28:04.170196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:04.475575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6748): Launched 19:28:04.740510 run iperf3-srv_10.42.42.10(pid=6749): Launched 19:28:04.853941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:28:05.057271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:05.363681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6750): Launched 19:28:05.627792 run iperf3-srv_10.42.42.10(pid=6751): Launched 19:28:05.740826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:28:05.943688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:06.248479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6752): Launched 19:28:06.512886 run iperf3-srv_10.42.42.10(pid=6753): Launched 19:28:06.626416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:28:06.829427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:07.134161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6754): Launched 19:28:07.398222 run iperf3-srv_10.42.42.10(pid=6755): Launched 19:28:07.513596 tst iperf3m4.py:8: start network... 19:28:07.717195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:08.187062 run create_hlr_db(pid=6756): Launched 19:28:08.311556 bus /gobi_6: Setting Powered False 19:28:09.372465 run create_hlr_db(pid=6756): Terminated: ok {rc=0} 19:28:09.814806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6758): Launched 19:28:10.140585 run osmo-hlr_10.42.42.2(pid=6759): Launched 19:28:10.265225 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:10.824315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6761): Launched 19:28:11.150327 run osmo-stp_10.42.42.5(pid=6762): Launched 19:28:11.274308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:11.832004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6765): Launched 19:28:11.957374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:12.232139 run patchelf(pid=6766): Launched 19:28:12.411570 run osmo-stp_10.42.42.5(pid=6762): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6762)] 19:28:12.548653 run osmo-stp_10.42.42.5(pid=6762): stdout: | (launched: 2022-12-09_19:28:11.091000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:12.687424 run osmo-stp_10.42.42.5(pid=6762): stderr: | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192811279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:12.825992 run osmo-stp_10.42.42.5(pid=6762): stdout: | (launched: 2022-12-09_19:28:11.091000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:12.958941 run osmo-stp_10.42.42.5(pid=6762): stderr: | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192811279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192811279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192811280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:13.116246 run patchelf(pid=6766): Terminating (SIGINT) 19:28:13.298403 run patchelf(pid=6766): Terminated: ok {rc=0} 19:28:13.429310 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6762): Process ended prematurely: osmo-stp_10.42.42.5(pid=6762) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6762)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:28:13.439761 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:28:13.469297 run osmo-hlr_10.42.42.2(pid=6759): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6759)] 19:28:13.519583 run osmo-hlr_10.42.42.2(pid=6759): stdout: | (launched: 2022-12-09_19:28:10.081458) 19:28:13.571140 run osmo-hlr_10.42.42.2(pid=6759): stderr: | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192810276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192810288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192810297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192810297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192810297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:13.622958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6748): Terminating (SIGTERM) 19:28:13.664887 run iperf3-srv_10.42.42.10(pid=6749): Terminating (SIGTERM) 19:28:13.706659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6750): Terminating (SIGTERM) 19:28:13.748635 run iperf3-srv_10.42.42.10(pid=6751): Terminating (SIGTERM) 19:28:13.790503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6752): Terminating (SIGTERM) 19:28:13.832444 run iperf3-srv_10.42.42.10(pid=6753): Terminating (SIGTERM) 19:28:13.874267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6754): Terminating (SIGTERM) 19:28:13.916334 run iperf3-srv_10.42.42.10(pid=6755): Terminating (SIGTERM) 19:28:13.958350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6758): Terminating (SIGTERM) 19:28:14.000417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6761): Terminating (SIGTERM) 19:28:14.042489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6765): Terminating (SIGTERM) 19:28:14.084857 --- ParallelTerminationStrategy: PID 6748 died... 19:28:14.105067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6748): Terminated: ok {rc=0} 19:28:14.152112 --- ParallelTerminationStrategy: PID 6749 died... 19:28:14.171791 run iperf3-srv_10.42.42.10(pid=6749): Terminated {rc=256} 19:28:14.218142 --- ParallelTerminationStrategy: PID 6750 died... 19:28:14.237764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6750): Terminated: ok {rc=0} 19:28:14.284042 --- ParallelTerminationStrategy: PID 6751 died... 19:28:14.303615 run iperf3-srv_10.42.42.10(pid=6751): Terminated {rc=256} 19:28:14.349811 --- ParallelTerminationStrategy: PID 6752 died... 19:28:14.369459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6752): Terminated: ok {rc=0} 19:28:14.415761 --- ParallelTerminationStrategy: PID 6753 died... 19:28:14.435143 run iperf3-srv_10.42.42.10(pid=6753): Terminated {rc=256} 19:28:14.481157 --- ParallelTerminationStrategy: PID 6754 died... 19:28:14.500632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6754): Terminated: ok {rc=0} 19:28:14.546996 --- ParallelTerminationStrategy: PID 6755 died... 19:28:14.566530 run iperf3-srv_10.42.42.10(pid=6755): Terminated {rc=256} 19:28:14.612848 --- ParallelTerminationStrategy: PID 6758 died... 19:28:14.632801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6758): Terminated: ok {rc=0} 19:28:14.679064 --- ParallelTerminationStrategy: PID 6761 died... 19:28:14.698708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6761): Terminated: ok {rc=0} 19:28:14.745175 --- ParallelTerminationStrategy: PID 6765 died... 19:28:14.764619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6765): Terminated: ok {rc=0} 19:28:14.852180 bus /gobi_4: Setting Powered False 19:28:15.959220 bus /gobi_4: Setting Powered False 19:28:17.081727 bus /gobi_1: Setting Powered False 19:28:18.184312 bus /gobi_1: Setting Powered False 19:28:19.298960 bus /gobi_0: Setting Powered False 19:28:20.397316 bus /gobi_0: Setting Powered False 19:28:21.512878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:28:22.614065 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:22.625979 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:28:22.697622 tst ping.py: using LAC 23206 19:28:22.818987 tst ping.py: using RAC 1 19:28:22.935027 tst ping.py: using CellId 23206 19:28:23.050519 tst ping.py: using BVCI 23207 19:28:23.160548 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.171548 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.182377 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.193795 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.205048 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.216328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.227791 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:23.239121 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:23.354997 tst ping.py:19: start network... 19:28:23.554356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:24.014497 run create_hlr_db(pid=6767): Launched 19:28:24.134531 bus /gobi_6: Setting Powered False 19:28:25.193553 run create_hlr_db(pid=6767): Terminated: ok {rc=0} 19:28:25.630409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Launched 19:28:25.949575 run osmo-hlr_10.42.42.2(pid=6771): Launched 19:28:26.071187 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:26.625063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Launched 19:28:26.943880 run osmo-stp_10.42.42.5(pid=6774): Launched 19:28:27.065284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:27.618368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6776): Launched 19:28:27.741705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:28.011424 run patchelf(pid=6777): Launched 19:28:28.189238 run osmo-stp_10.42.42.5(pid=6774): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] 19:28:28.323839 run osmo-stp_10.42.42.5(pid=6774): stdout: | (launched: 2022-12-09_19:28:26.885559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:28.460367 run osmo-stp_10.42.42.5(pid=6774): stderr: | [0;m[38;5;43m20221209192827076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192827076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192827077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192827077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192827077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192827077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192827078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:28.596420 run osmo-stp_10.42.42.5(pid=6774): stdout: | (launched: 2022-12-09_19:28:26.885559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:28.727191 run osmo-stp_10.42.42.5(pid=6774): stderr: | [0;m[38;5;43m20221209192827076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192827076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192827077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192827077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192827077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192827077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192827078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:28.881785 run patchelf(pid=6777): Terminating (SIGINT) 19:28:29.059543 run patchelf(pid=6777): Terminated: ok {rc=0} 19:28:29.188545 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6774): Process ended prematurely: osmo-stp_10.42.42.5(pid=6774) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 19:28:29.198423 tst ping.py:22: Test FAILED (6.6 sec) 19:28:29.227096 run osmo-hlr_10.42.42.2(pid=6771): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6771)] 19:28:29.277102 run osmo-hlr_10.42.42.2(pid=6771): stdout: | (launched: 2022-12-09_19:28:25.891464) 19:28:29.328908 run osmo-hlr_10.42.42.2(pid=6771): stderr: | [0;m[1;31m20221209192826088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192826089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192826089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192826089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192826089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192826089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192826099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192826107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192826107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192826107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:29.380788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Terminating (SIGTERM) 19:28:29.422670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Terminating (SIGTERM) 19:28:29.464450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6776): Terminating (SIGTERM) 19:28:29.506852 --- ParallelTerminationStrategy: PID 6770 died... 19:28:29.527108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Terminated: ok {rc=0} 19:28:29.573825 --- ParallelTerminationStrategy: PID 6773 died... 19:28:29.593483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Terminated: ok {rc=0} 19:28:29.639952 --- ParallelTerminationStrategy: PID 6776 died... 19:28:29.659572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6776): Terminated: ok {rc=0} 19:28:29.746114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:28:30.842144 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:30.864736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:28:30.952239 tst ping_idle_ping.py: using LAC 23207 19:28:31.080627 tst ping_idle_ping.py: using RAC 2 19:28:31.245639 tst ping_idle_ping.py: using CellId 23207 19:28:31.406761 tst ping_idle_ping.py: using BVCI 23208 19:28:31.519487 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.531335 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.542726 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.554403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.566584 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.578073 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.589967 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:28:31.602841 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:28:31.720790 tst ping_idle_ping.py:24: start network... 19:28:31.929615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:32.416472 run create_hlr_db(pid=6778): Launched 19:28:32.539058 bus /gobi_6: Setting Powered False 19:28:33.602915 run create_hlr_db(pid=6778): Terminated: ok {rc=0} 19:28:34.049087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Launched 19:28:34.368320 run osmo-hlr_10.42.42.2(pid=6781): Launched 19:28:34.492211 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:35.041943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Launched 19:28:35.361960 run osmo-stp_10.42.42.5(pid=6784): Launched 19:28:35.487643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:36.038214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Launched 19:28:36.161354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:36.430748 run patchelf(pid=6787): Launched 19:28:36.609691 run osmo-stp_10.42.42.5(pid=6784): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] 19:28:36.744939 run osmo-stp_10.42.42.5(pid=6784): stdout: | (launched: 2022-12-09_19:28:35.303695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:36.881730 run osmo-stp_10.42.42.5(pid=6784): stderr: | [0;m[38;5;43m20221209192835494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192835494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192835495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192835495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192835495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192835496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192835496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:37.018498 run osmo-stp_10.42.42.5(pid=6784): stdout: | (launched: 2022-12-09_19:28:35.303695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:37.149981 run osmo-stp_10.42.42.5(pid=6784): stderr: | [0;m[38;5;43m20221209192835494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192835494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192835495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192835495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192835495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192835496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192835496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:37.305352 run patchelf(pid=6787): Terminating (SIGINT) 19:28:37.483682 run patchelf(pid=6787): Terminated: ok {rc=0} 19:28:37.612194 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6784): Process ended prematurely: osmo-stp_10.42.42.5(pid=6784) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:28:37.621770 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:28:37.649840 run osmo-hlr_10.42.42.2(pid=6781): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6781)] 19:28:37.699571 run osmo-hlr_10.42.42.2(pid=6781): stdout: | (launched: 2022-12-09_19:28:34.309946) 19:28:37.750781 run osmo-hlr_10.42.42.2(pid=6781): stderr: | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192834507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192834518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192834527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192834527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192834527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:37.802123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Terminating (SIGTERM) 19:28:37.843363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Terminating (SIGTERM) 19:28:37.884776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Terminating (SIGTERM) 19:28:37.927065 --- ParallelTerminationStrategy: PID 6780 died... 19:28:37.946686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Terminated: ok {rc=0} 19:28:37.993451 --- ParallelTerminationStrategy: PID 6783 died... 19:28:38.013088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Terminated: ok {rc=0} 19:28:38.059112 --- ParallelTerminationStrategy: PID 6786 died... 19:28:38.078584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Terminated: ok {rc=0} 19:28:38.166232 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:28:39.466853 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:28:39.472503 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:28:39.506424 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:28:39.544756 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:28:39.629639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:28:39.662606 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:28:39.701334 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:28:40.299784 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:28:40.353924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.365299 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:28:40.434408 tst cs_paging_gprs_active.py: using LAC 23208 19:28:40.560117 tst cs_paging_gprs_active.py: using RAC 3 19:28:40.685351 tst cs_paging_gprs_active.py: using CellId 23208 19:28:40.815584 tst cs_paging_gprs_active.py: using BVCI 23209 19:28:40.935382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.946541 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.957607 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.969058 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.980224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:40.991694 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:41.003205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:41.014587 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:41.026332 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:28:41.148542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:28:41.271248 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:28:41.476464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:41.782262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6791): Launched 19:28:42.048090 run iperf3-srv_10.42.42.10(pid=6792): Launched 19:28:42.161590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:28:42.365630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:42.670320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6793): Launched 19:28:42.935501 run iperf3-srv_10.42.42.10(pid=6794): Launched 19:28:43.049180 tst cs_paging_gprs_active.py:38: start network... 19:28:43.252809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:43.723311 run create_hlr_db(pid=6795): Launched 19:28:43.847865 bus /gobi_6: Setting Powered False 19:28:44.909133 run create_hlr_db(pid=6795): Terminated: ok {rc=0} 19:28:45.351981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6797): Launched 19:28:45.676559 run osmo-hlr_10.42.42.2(pid=6798): Launched 19:28:45.800225 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:46.469721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6800): Launched 19:28:46.785416 run osmo-stp_10.42.42.5(pid=6801): Launched 19:28:46.962249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:47.624923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6803): Launched 19:28:47.743035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:47.999392 run patchelf(pid=6804): Launched 19:28:48.169363 run osmo-stp_10.42.42.5(pid=6801): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6801)] 19:28:48.297567 run osmo-stp_10.42.42.5(pid=6801): stdout: | (launched: 2022-12-09_19:28:46.727693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:48.426982 run osmo-stp_10.42.42.5(pid=6801): stderr: | [0;m[38;5;43m20221209192847085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192847085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192847086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192847086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:48.556434 run osmo-stp_10.42.42.5(pid=6801): stdout: | (launched: 2022-12-09_19:28:46.727693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:48.679962 run osmo-stp_10.42.42.5(pid=6801): stderr: | [0;m[38;5;43m20221209192847085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192847085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192847086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192847086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:48.826755 run patchelf(pid=6804): Terminating (SIGINT) 19:28:48.996185 run patchelf(pid=6804): Terminated: ok {rc=0} 19:28:49.118815 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6801): Process ended prematurely: osmo-stp_10.42.42.5(pid=6801) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6801)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:28:49.128170 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:28:49.154574 run osmo-hlr_10.42.42.2(pid=6798): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6798)] 19:28:49.200558 run osmo-hlr_10.42.42.2(pid=6798): stdout: | (launched: 2022-12-09_19:28:45.617340) 19:28:49.248507 run osmo-hlr_10.42.42.2(pid=6798): stderr: | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192845816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192845836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192845848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192845849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192845849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:49.296706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6791): Terminating (SIGTERM) 19:28:49.335182 run iperf3-srv_10.42.42.10(pid=6792): Terminating (SIGTERM) 19:28:49.373398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6793): Terminating (SIGTERM) 19:28:49.411500 run iperf3-srv_10.42.42.10(pid=6794): Terminating (SIGTERM) 19:28:49.449621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6797): Terminating (SIGTERM) 19:28:49.487738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6800): Terminating (SIGTERM) 19:28:49.525956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6803): Terminating (SIGTERM) 19:28:49.564482 --- ParallelTerminationStrategy: PID 6791 died... 19:28:49.582988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6791): Terminated: ok {rc=0} 19:28:49.625386 --- ParallelTerminationStrategy: PID 6792 died... 19:28:49.643668 run iperf3-srv_10.42.42.10(pid=6792): Terminated {rc=256} 19:28:49.686500 --- ParallelTerminationStrategy: PID 6793 died... 19:28:49.704449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6793): Terminated: ok {rc=0} 19:28:49.747223 --- ParallelTerminationStrategy: PID 6794 died... 19:28:49.765204 run iperf3-srv_10.42.42.10(pid=6794): Terminated {rc=256} 19:28:49.807568 --- ParallelTerminationStrategy: PID 6797 died... 19:28:49.825660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6797): Terminated: ok {rc=0} 19:28:49.868429 --- ParallelTerminationStrategy: PID 6800 died... 19:28:49.886735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6800): Terminated: ok {rc=0} 19:28:49.929498 --- ParallelTerminationStrategy: PID 6803 died... 19:28:49.947639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6803): Terminated: ok {rc=0} 19:28:50.030389 bus /gobi_0: Setting Powered False 19:28:51.129051 bus /gobi_0: Setting Powered False 19:28:52.242729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:28:53.387361 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.398756 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:28:53.468839 tst iperf3.py: using LAC 23209 19:28:53.589147 tst iperf3.py: using RAC 4 19:28:53.708767 tst iperf3.py: using CellId 23209 19:28:53.827820 tst iperf3.py: using BVCI 23210 19:28:53.937930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.948663 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.959207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.969794 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.980204 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:53.990741 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:54.001341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:54.011679 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:28:54.022260 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:28:54.140855 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:28:54.362169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:54.688920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6805): Launched 19:28:54.971668 run iperf3-srv_10.42.42.10(pid=6806): Launched 19:28:55.093707 tst iperf3.py:8: start network... 19:28:55.315047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:55.819842 run create_hlr_db(pid=6807): Launched 19:28:55.943950 bus /gobi_6: Setting Powered False 19:28:57.007715 run create_hlr_db(pid=6807): Terminated: ok {rc=0} 19:28:57.443026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6809): Launched 19:28:57.748764 run osmo-hlr_10.42.42.2(pid=6810): Launched 19:28:57.864293 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:58.390061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6812): Launched 19:28:58.693657 run osmo-stp_10.42.42.5(pid=6813): Launched 19:28:58.809283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:59.333576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6815): Launched 19:28:59.450288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:59.706308 run patchelf(pid=6816): Launched 19:28:59.876612 run osmo-stp_10.42.42.5(pid=6813): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6813)] 19:29:00.004680 run osmo-stp_10.42.42.5(pid=6813): stdout: | (launched: 2022-12-09_19:28:58.637885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:00.134497 run osmo-stp_10.42.42.5(pid=6813): stderr: | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192858811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:00.265296 run osmo-stp_10.42.42.5(pid=6813): stdout: | (launched: 2022-12-09_19:28:58.637885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:00.388936 run osmo-stp_10.42.42.5(pid=6813): stderr: | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192858810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192858811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192858811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:00.536131 run patchelf(pid=6816): Terminating (SIGINT) 19:29:00.705914 run patchelf(pid=6816): Terminated: ok {rc=0} 19:29:00.828221 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6813): Process ended prematurely: osmo-stp_10.42.42.5(pid=6813) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6813)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 19:29:00.838196 tst iperf3.py:8: Test FAILED (7.5 sec) 19:29:00.866791 run osmo-hlr_10.42.42.2(pid=6810): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6810)] 19:29:00.919979 run osmo-hlr_10.42.42.2(pid=6810): stdout: | (launched: 2022-12-09_19:28:57.691810) 19:29:00.982685 run osmo-hlr_10.42.42.2(pid=6810): stderr: | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192857869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192857907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192857917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192857917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192857917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:01.045671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6805): Terminating (SIGTERM) 19:29:01.086357 run iperf3-srv_10.42.42.10(pid=6806): Terminating (SIGTERM) 19:29:01.129954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6809): Terminating (SIGTERM) 19:29:01.171643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6812): Terminating (SIGTERM) 19:29:01.214100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6815): Terminating (SIGTERM) 19:29:01.254975 --- ParallelTerminationStrategy: PID 6805 died... 19:29:01.273941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6805): Terminated: ok {rc=0} 19:29:01.317854 --- ParallelTerminationStrategy: PID 6806 died... 19:29:01.336638 run iperf3-srv_10.42.42.10(pid=6806): Terminated {rc=256} 19:29:01.380441 --- ParallelTerminationStrategy: PID 6809 died... 19:29:01.399499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6809): Terminated: ok {rc=0} 19:29:01.443359 --- ParallelTerminationStrategy: PID 6812 died... 19:29:01.462348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6812): Terminated: ok {rc=0} 19:29:01.506615 --- ParallelTerminationStrategy: PID 6815 died... 19:29:01.525822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6815): Terminated: ok {rc=0} 19:29:01.613429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:29:02.755658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:02.766968 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:29:02.836706 tst iperf3m4.py: using LAC 23210 19:29:02.954807 tst iperf3m4.py: using RAC 5 19:29:03.075553 tst iperf3m4.py: using CellId 23210 19:29:03.196082 tst iperf3m4.py: using BVCI 23211 19:29:03.305883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.316543 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.327099 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.337671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.348152 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.358722 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.369334 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.379713 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:03.390754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:03.504859 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:03.624877 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:03.747215 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:03.867143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:29:04.088287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:04.416851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6817): Launched 19:29:04.699640 run iperf3-srv_10.42.42.10(pid=6818): Launched 19:29:04.821804 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:29:05.042537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:05.371423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6819): Launched 19:29:05.655116 run iperf3-srv_10.42.42.10(pid=6820): Launched 19:29:05.777295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:29:05.998399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:06.326683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6821): Launched 19:29:06.610698 run iperf3-srv_10.42.42.10(pid=6822): Launched 19:29:06.733816 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:29:06.954149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:07.281614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6823): Launched 19:29:07.565569 run iperf3-srv_10.42.42.10(pid=6824): Launched 19:29:07.687327 tst iperf3m4.py:8: start network... 19:29:07.908340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:08.415494 run create_hlr_db(pid=6825): Launched 19:29:08.539038 bus /gobi_6: Setting Powered False 19:29:09.603283 run create_hlr_db(pid=6825): Terminated: ok {rc=0} 19:29:10.037289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6827): Launched 19:29:10.342118 run osmo-hlr_10.42.42.2(pid=6828): Launched 19:29:10.459771 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:10.983207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6830): Launched 19:29:11.286100 run osmo-stp_10.42.42.5(pid=6831): Launched 19:29:11.400824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:11.923630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6833): Launched 19:29:12.038526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:12.294772 run patchelf(pid=6834): Launched 19:29:12.462740 run osmo-stp_10.42.42.5(pid=6831): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6831)] 19:29:12.590631 run osmo-stp_10.42.42.5(pid=6831): stdout: | (launched: 2022-12-09_19:29:11.230305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:12.720377 run osmo-stp_10.42.42.5(pid=6831): stderr: | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192911399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:12.850106 run osmo-stp_10.42.42.5(pid=6831): stdout: | (launched: 2022-12-09_19:29:11.230305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:12.974119 run osmo-stp_10.42.42.5(pid=6831): stderr: | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192911398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192911399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192911399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:13.121113 run patchelf(pid=6834): Terminating (SIGINT) 19:29:13.290944 run patchelf(pid=6834): Terminated: ok {rc=0} 19:29:13.413203 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6831): Process ended prematurely: osmo-stp_10.42.42.5(pid=6831) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6831)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:29:13.422617 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:29:13.449711 run osmo-hlr_10.42.42.2(pid=6828): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6828)] 19:29:13.496480 run osmo-hlr_10.42.42.2(pid=6828): stdout: | (launched: 2022-12-09_19:29:10.286307) 19:29:13.544645 run osmo-hlr_10.42.42.2(pid=6828): stderr: | [0;m[1;31m20221209192910459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192910459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192910459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192910460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192910460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192910460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192910473 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192910482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192910483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192910483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:13.593509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6817): Terminating (SIGTERM) 19:29:13.632325 run iperf3-srv_10.42.42.10(pid=6818): Terminating (SIGTERM) 19:29:13.671079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6819): Terminating (SIGTERM) 19:29:13.709668 run iperf3-srv_10.42.42.10(pid=6820): Terminating (SIGTERM) 19:29:13.748266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6821): Terminating (SIGTERM) 19:29:13.786854 run iperf3-srv_10.42.42.10(pid=6822): Terminating (SIGTERM) 19:29:13.825397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6823): Terminating (SIGTERM) 19:29:13.865176 run iperf3-srv_10.42.42.10(pid=6824): Terminating (SIGTERM) 19:29:13.903706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6827): Terminating (SIGTERM) 19:29:13.942347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6830): Terminating (SIGTERM) 19:29:13.980761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6833): Terminating (SIGTERM) 19:29:14.020293 --- ParallelTerminationStrategy: PID 6817 died... 19:29:14.038999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6817): Terminated: ok {rc=0} 19:29:14.082157 --- ParallelTerminationStrategy: PID 6818 died... 19:29:14.100516 run iperf3-srv_10.42.42.10(pid=6818): Terminated {rc=256} 19:29:14.143778 --- ParallelTerminationStrategy: PID 6819 died... 19:29:14.162063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6819): Terminated: ok {rc=0} 19:29:14.205361 --- ParallelTerminationStrategy: PID 6820 died... 19:29:14.223552 run iperf3-srv_10.42.42.10(pid=6820): Terminated {rc=256} 19:29:14.266369 --- ParallelTerminationStrategy: PID 6821 died... 19:29:14.284394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6821): Terminated: ok {rc=0} 19:29:14.327391 --- ParallelTerminationStrategy: PID 6822 died... 19:29:14.345685 run iperf3-srv_10.42.42.10(pid=6822): Terminated {rc=256} 19:29:14.388560 --- ParallelTerminationStrategy: PID 6823 died... 19:29:14.407003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6823): Terminated: ok {rc=0} 19:29:14.449772 --- ParallelTerminationStrategy: PID 6824 died... 19:29:14.468034 run iperf3-srv_10.42.42.10(pid=6824): Terminated {rc=256} 19:29:14.510688 --- ParallelTerminationStrategy: PID 6827 died... 19:29:14.528866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6827): Terminated: ok {rc=0} 19:29:14.571705 --- ParallelTerminationStrategy: PID 6830 died... 19:29:14.589886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6830): Terminated: ok {rc=0} 19:29:14.632466 --- ParallelTerminationStrategy: PID 6833 died... 19:29:14.650719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6833): Terminated: ok {rc=0} 19:29:14.731397 bus /gobi_4: Setting Powered False 19:29:15.828119 bus /gobi_4: Setting Powered False 19:29:16.955027 bus /gobi_1: Setting Powered False 19:29:18.054187 bus /gobi_1: Setting Powered False 19:29:19.166737 bus /gobi_0: Setting Powered False 19:29:20.262406 bus /gobi_0: Setting Powered False 19:29:21.376776 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:29:22.477711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:22.489614 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:29:22.562491 tst ping.py: using LAC 23211 19:29:22.681103 tst ping.py: using RAC 6 19:29:22.797971 tst ping.py: using CellId 23211 19:29:22.915141 tst ping.py: using BVCI 23212 19:29:23.024706 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.035796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.046570 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.057162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.067666 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.078344 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.089049 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:23.099585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:23.218273 tst ping.py:19: start network... 19:29:23.434511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:23.930389 run create_hlr_db(pid=6835): Launched 19:29:24.054371 bus /gobi_6: Setting Powered False 19:29:25.117650 run create_hlr_db(pid=6835): Terminated: ok {rc=0} 19:29:25.546685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6837): Launched 19:29:25.846659 run osmo-hlr_10.42.42.2(pid=6838): Launched 19:29:25.961667 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:26.478914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6840): Launched 19:29:26.776646 run osmo-stp_10.42.42.5(pid=6841): Launched 19:29:26.889870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:27.403741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6843): Launched 19:29:27.517920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:27.770577 run patchelf(pid=6844): Launched 19:29:27.937869 run osmo-stp_10.42.42.5(pid=6841): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6841)] 19:29:28.064748 run osmo-stp_10.42.42.5(pid=6841): stdout: | (launched: 2022-12-09_19:29:26.721629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:28.192238 run osmo-stp_10.42.42.5(pid=6841): stderr: | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192926892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:28.320308 run osmo-stp_10.42.42.5(pid=6841): stdout: | (launched: 2022-12-09_19:29:26.721629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:28.442520 run osmo-stp_10.42.42.5(pid=6841): stderr: | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192926892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192926892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192926893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:28.587225 run patchelf(pid=6844): Terminating (SIGINT) 19:29:28.754401 run patchelf(pid=6844): Terminated: ok {rc=0} 19:29:28.874796 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6841): Process ended prematurely: osmo-stp_10.42.42.5(pid=6841) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6841)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 19:29:28.883613 tst ping.py:22: Test FAILED (6.4 sec) 19:29:28.909828 run osmo-hlr_10.42.42.2(pid=6838): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6838)] 19:29:28.956195 run osmo-hlr_10.42.42.2(pid=6838): stdout: | (launched: 2022-12-09_19:29:25.791397) 19:29:29.004222 run osmo-hlr_10.42.42.2(pid=6838): stderr: | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192925967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192925980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192925988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192925989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192925989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:29.052825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6837): Terminating (SIGTERM) 19:29:29.091448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6840): Terminating (SIGTERM) 19:29:29.130093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6843): Terminating (SIGTERM) 19:29:29.168938 --- ParallelTerminationStrategy: PID 6837 died... 19:29:29.187849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6837): Terminated: ok {rc=0} 19:29:29.231076 --- ParallelTerminationStrategy: PID 6840 died... 19:29:29.249489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6840): Terminated: ok {rc=0} 19:29:29.292230 --- ParallelTerminationStrategy: PID 6843 died... 19:29:29.310583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6843): Terminated: ok {rc=0} 19:29:29.391552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:29:30.475598 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:30.488119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:29:30.563620 tst ping_idle_ping.py: using LAC 23212 19:29:30.690879 tst ping_idle_ping.py: using RAC 7 19:29:30.816909 tst ping_idle_ping.py: using CellId 23212 19:29:30.970749 tst ping_idle_ping.py: using BVCI 23213 19:29:31.098999 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.110935 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.122691 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.135063 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.148032 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.159954 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.172807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:29:31.186119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:29:31.303284 tst ping_idle_ping.py:24: start network... 19:29:31.523962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:32.035852 run create_hlr_db(pid=6845): Launched 19:29:32.184887 bus /gobi_6: Setting Powered False 19:29:33.248484 run create_hlr_db(pid=6845): Terminated: ok {rc=0} 19:29:33.677383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Launched 19:29:33.978277 run osmo-hlr_10.42.42.2(pid=6849): Launched 19:29:34.092533 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:34.623923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Launched 19:29:34.922600 run osmo-stp_10.42.42.5(pid=6852): Launched 19:29:35.036018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:35.552372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Launched 19:29:35.665996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:35.918302 run patchelf(pid=6855): Launched 19:29:36.084334 run osmo-stp_10.42.42.5(pid=6852): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] 19:29:36.210760 run osmo-stp_10.42.42.5(pid=6852): stdout: | (launched: 2022-12-09_19:29:34.867184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:36.338382 run osmo-stp_10.42.42.5(pid=6852): stderr: | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192935036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:36.465853 run osmo-stp_10.42.42.5(pid=6852): stdout: | (launched: 2022-12-09_19:29:34.867184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:36.587730 run osmo-stp_10.42.42.5(pid=6852): stderr: | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192935035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192935036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192935036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:36.732280 run patchelf(pid=6855): Terminating (SIGINT) 19:29:36.900678 run patchelf(pid=6855): Terminated: ok {rc=0} 19:29:37.020583 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6852): Process ended prematurely: osmo-stp_10.42.42.5(pid=6852) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:29:37.029466 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:29:37.056143 run osmo-hlr_10.42.42.2(pid=6849): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6849)] 19:29:37.103595 run osmo-hlr_10.42.42.2(pid=6849): stdout: | (launched: 2022-12-09_19:29:33.923027) 19:29:37.152207 run osmo-hlr_10.42.42.2(pid=6849): stderr: | [0;m[1;31m20221209192934097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192934097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192934097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192934097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192934097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192934098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192934110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:37.201342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Terminating (SIGTERM) 19:29:37.240560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Terminating (SIGTERM) 19:29:37.279729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Terminating (SIGTERM) 19:29:37.319350 --- ParallelTerminationStrategy: PID 6847 died... 19:29:37.338180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Terminated: ok {rc=0} 19:29:37.381700 --- ParallelTerminationStrategy: PID 6851 died... 19:29:37.399940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Terminated: ok {rc=0} 19:29:37.443391 --- ParallelTerminationStrategy: PID 6854 died... 19:29:37.461819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Terminated: ok {rc=0} 19:29:37.546381 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:29:38.847850 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:38.854690 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:29:38.887381 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:29:38.921386 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:29:38.975097 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:29:39.007608 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:29:39.041415 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:29:39.600859 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:29:39.606804 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:39.618276 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:29:39.686005 tst switch_tch_pdch.py: using LAC 23213 19:29:39.806410 tst switch_tch_pdch.py: using RAC 8 19:29:39.926025 tst switch_tch_pdch.py: using CellId 23213 19:29:40.056110 tst switch_tch_pdch.py: using BVCI 23214 19:29:40.175134 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.186917 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.198478 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.210622 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.223246 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.235036 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.247529 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:29:40.259434 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:40.381799 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:40.502694 tst switch_tch_pdch.py:51: start network... 19:29:40.702122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:41.163729 run create_hlr_db(pid=6860): Launched 19:29:41.286624 bus /gobi_6: Setting Powered False 19:29:42.346388 run create_hlr_db(pid=6860): Terminated: ok {rc=0} 19:29:42.761968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Launched 19:29:43.058693 run osmo-hlr_10.42.42.2(pid=6863): Launched 19:29:43.172462 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:43.702254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Launched 19:29:43.999112 run osmo-stp_10.42.42.5(pid=6866): Launched 19:29:44.113360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:44.627813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6868): Launched 19:29:44.740603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:44.991752 run patchelf(pid=6869): Launched 19:29:45.156338 run osmo-stp_10.42.42.5(pid=6866): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] 19:29:45.281789 run osmo-stp_10.42.42.5(pid=6866): stdout: | (launched: 2022-12-09_19:29:43.944177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:45.408528 run osmo-stp_10.42.42.5(pid=6866): stderr: | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192944113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:45.535356 run osmo-stp_10.42.42.5(pid=6866): stdout: | (launched: 2022-12-09_19:29:43.944177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:45.656512 run osmo-stp_10.42.42.5(pid=6866): stderr: | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192944112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192944113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192944113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:45.800458 run patchelf(pid=6869): Terminating (SIGINT) 19:29:46.001530 run patchelf(pid=6869): Terminated: ok {rc=0} 19:29:46.125096 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6866): Process ended prematurely: osmo-stp_10.42.42.5(pid=6866) [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:29:46.134719 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 19:29:46.162423 run osmo-hlr_10.42.42.2(pid=6863): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6863)] 19:29:46.210134 run osmo-hlr_10.42.42.2(pid=6863): stdout: | (launched: 2022-12-09_19:29:43.003856) 19:29:46.259426 run osmo-hlr_10.42.42.2(pid=6863): stderr: | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192943178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192943190 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192943200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192943200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192943200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:46.309074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Terminating (SIGTERM) 19:29:46.349774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Terminating (SIGTERM) 19:29:46.390873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6868): Terminating (SIGTERM) 19:29:46.431552 --- ParallelTerminationStrategy: PID 6862 died... 19:29:46.451098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Terminated: ok {rc=0} 19:29:46.496469 --- ParallelTerminationStrategy: PID 6865 died... 19:29:46.515337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Terminated: ok {rc=0} 19:29:46.559048 --- ParallelTerminationStrategy: PID 6868 died... 19:29:46.577818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6868): Terminated: ok {rc=0} 19:29:46.663192 bus /gobi_0: Setting Powered False 19:29:47.762279 bus /gobi_0: Setting Powered False 19:29:48.876902 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:29:50.130455 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:50.136851 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:29:50.171549 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:29:50.207200 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:29:50.260745 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:29:50.294469 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:29:50.329597 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:29:50.887316 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:29:50.892816 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:50.904104 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:29:50.976487 tst switch_tch_pdch.py: using LAC 23214 19:29:51.101350 tst switch_tch_pdch.py: using RAC 9 19:29:51.225118 tst switch_tch_pdch.py: using CellId 23214 19:29:51.350556 tst switch_tch_pdch.py: using BVCI 23215 19:29:51.466166 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.477683 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.488848 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.500473 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.511831 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.523331 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.534698 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:29:51.545947 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:29:51.661852 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:29:51.776818 tst switch_tch_pdch.py:51: start network... 19:29:51.977342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:52.414556 run create_hlr_db(pid=6873): Launched 19:29:52.536896 bus /gobi_6: Setting Powered False 19:29:53.600482 run create_hlr_db(pid=6873): Terminated: ok {rc=0} 19:29:54.001995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Launched 19:29:54.301050 run osmo-hlr_10.42.42.2(pid=6876): Launched 19:29:54.413848 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:54.900033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Launched 19:29:55.196845 run osmo-stp_10.42.42.5(pid=6879): Launched 19:29:55.308688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:55.797102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6881): Launched 19:29:55.910021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:56.160867 run patchelf(pid=6882): Launched 19:29:56.326879 run osmo-stp_10.42.42.5(pid=6879): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] 19:29:56.452448 run osmo-stp_10.42.42.5(pid=6879): stdout: | (launched: 2022-12-09_19:29:55.142220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:56.579654 run osmo-stp_10.42.42.5(pid=6879): stderr: | [0;m[38;5;43m20221209192955312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192955312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192955313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192955313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:56.706673 run osmo-stp_10.42.42.5(pid=6879): stdout: | (launched: 2022-12-09_19:29:55.142220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:56.828147 run osmo-stp_10.42.42.5(pid=6879): stderr: | [0;m[38;5;43m20221209192955312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209192955312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209192955313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209192955313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209192955314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:56.972285 run patchelf(pid=6882): Terminating (SIGINT) 19:29:57.139486 run patchelf(pid=6882): Terminated: ok {rc=0} 19:29:57.259843 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6879): Process ended prematurely: osmo-stp_10.42.42.5(pid=6879) [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:29:57.268792 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 19:29:57.295399 run osmo-hlr_10.42.42.2(pid=6876): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6876)] 19:29:57.341922 run osmo-hlr_10.42.42.2(pid=6876): stdout: | (launched: 2022-12-09_19:29:54.246285) 19:29:57.389895 run osmo-hlr_10.42.42.2(pid=6876): stderr: | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209192954423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209192954436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209192954446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209192954446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209192954446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:57.438178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Terminating (SIGTERM) 19:29:57.476869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Terminating (SIGTERM) 19:29:57.515477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6881): Terminating (SIGTERM) 19:29:57.554436 --- ParallelTerminationStrategy: PID 6875 died... 19:29:57.572893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Terminated: ok {rc=0} 19:29:57.616431 --- ParallelTerminationStrategy: PID 6878 died... 19:29:57.634794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Terminated: ok {rc=0} 19:29:57.677862 --- ParallelTerminationStrategy: PID 6881 died... 19:29:57.696231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6881): Terminated: ok {rc=0} 19:29:57.780241 bus /gobi_0: Setting Powered False 19:29:58.878797 bus /gobi_0: Setting Powered False 19:29:59.993243 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 19:30:01.266110 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:01.270426 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:30:01.303961 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 19:30:01.311779 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:30:01.368479 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:30:01.400834 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 19:30:01.408667 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:30:01.976729 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 19:30:01.983242 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 19:30:01.998335 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:30:02.047755 tst mo_mt_sms.py: using LAC 23215 19:30:02.173492 tst mo_mt_sms.py: using RAC 10 19:30:02.300828 tst mo_mt_sms.py: using CellId 23215 19:30:02.425498 tst mo_mt_sms.py: using BVCI 23216 19:30:02.541643 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:30:02.658337 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:30:02.776658 tst mo_mt_sms.py:9: start nitb and bts... 19:30:02.994245 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:30:03.646886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6889): Launched 19:30:03.968517 run osmo-nitb_10.42.42.2(pid=6890): Launched 19:30:04.147864 run osmo-nitb_10.42.42.2(pid=6890): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6890)] 19:30:04.291845 run osmo-nitb_10.42.42.2(pid=6890): stdout: | (launched: 2022-12-09_19:30:03.910445) 19:30:04.436453 run osmo-nitb_10.42.42.2(pid=6890): stderr: | (launched: 2022-12-09_19:30:03.957954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:30:04.580878 run osmo-nitb_10.42.42.2(pid=6890): stdout: | (launched: 2022-12-09_19:30:03.910445) 19:30:04.719566 run osmo-nitb_10.42.42.2(pid=6890): stderr: | (launched: 2022-12-09_19:30:03.957954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6890) [trial-2363↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6890)] 19:30:05.091219 tst osmo-nitb_10.42.42.2(pid=6890): stdout: | (launched: 2022-12-09_19:30:03.910445) 19:30:05.221297 tst osmo-nitb_10.42.42.2(pid=6890): stderr: | (launched: 2022-12-09_19:30:03.957954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:30:05.374023 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6890) [trial-2363↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6890)] [trial-2363↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 19:30:05.382987 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 19:30:05.390071 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6889): Terminating (SIGTERM) 19:30:05.602183 --- ParallelTerminationStrategy: PID 6889 died... 19:30:05.623621 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6889): Terminated: ok {rc=0} 19:30:05.713350 bus /sierra_3: Setting Powered False 19:30:06.811464 bus /sierra_3: Setting Powered False 19:30:07.927249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 19:30:09.123343 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:09.127176 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:30:09.155977 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:30:09.182060 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:30:09.231071 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:30:09.259777 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:30:09.285758 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:30:09.835006 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 19:30:09.840092 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:09.850855 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:30:09.893419 tst mo_mt_sms.py: using LAC 23216 19:30:10.010999 tst mo_mt_sms.py: using RAC 11 19:30:10.126299 tst mo_mt_sms.py: using CellId 23216 19:30:10.243050 tst mo_mt_sms.py: using BVCI 23217 19:30:10.361796 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:10.372921 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:10.383920 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:10.395083 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:10.406845 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:10.417907 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:30:10.536436 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:30:10.651834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:11.116476 run create_hlr_db(pid=6894): Launched 19:30:11.238169 bus /sierra_2: Setting Powered False 19:30:12.298517 run create_hlr_db(pid=6894): Terminated: ok {rc=0} 19:30:12.735659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Launched 19:30:13.054896 run osmo-hlr_10.42.42.2(pid=6897): Launched 19:30:13.178468 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:13.733408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Launched 19:30:14.053848 run osmo-stp_10.42.42.5(pid=6900): Launched 19:30:14.177527 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:14.759668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Launched 19:30:15.079997 run osmo-msc_10.42.42.6(pid=6903): Launched 19:30:15.259261 run osmo-stp_10.42.42.5(pid=6900): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] 19:30:15.394901 run osmo-stp_10.42.42.5(pid=6900): stdout: | (launched: 2022-12-09_19:30:13.995580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:15.529986 run osmo-stp_10.42.42.5(pid=6900): stderr: | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193014186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:15.664087 run osmo-stp_10.42.42.5(pid=6900): stdout: | (launched: 2022-12-09_19:30:13.995580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:15.791700 run osmo-stp_10.42.42.5(pid=6900): stderr: | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193014186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193014186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193014187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:15.956820 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6900): Process ended prematurely: osmo-stp_10.42.42.5(pid=6900) [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 19:30:15.966002 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 19:30:15.993493 run osmo-hlr_10.42.42.2(pid=6897): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6897)] 19:30:16.042969 run osmo-hlr_10.42.42.2(pid=6897): stdout: | (launched: 2022-12-09_19:30:12.996619) 19:30:16.092770 run osmo-hlr_10.42.42.2(pid=6897): stderr: | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193013193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193013206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193013215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193013215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193013215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:16.162233 run osmo-msc_10.42.42.6(pid=6903): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6903)] 19:30:16.211932 run osmo-msc_10.42.42.6(pid=6903): stdout: | (launched: 2022-12-09_19:30:15.021493) 19:30:16.261828 run osmo-msc_10.42.42.6(pid=6903): stderr: | [0;m[38;5;43m20221209193015342 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193015342 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2fd94b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193015343 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193015343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193015343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193015343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193015345 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193015345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193015345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193015346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:16.312721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Terminating (SIGTERM) 19:30:16.354716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Terminating (SIGTERM) 19:30:16.398499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Terminating (SIGTERM) 19:30:16.441941 --- ParallelTerminationStrategy: PID 6896 died... 19:30:16.461447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Terminated: ok {rc=0} 19:30:16.507572 --- ParallelTerminationStrategy: PID 6899 died... 19:30:16.526672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Terminated: ok {rc=0} 19:30:16.571506 --- ParallelTerminationStrategy: PID 6902 died... 19:30:16.591222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Terminated: ok {rc=0} 19:30:16.682476 bus /sierra_3: Setting Powered False 19:30:17.787813 bus /sierra_3: Setting Powered False 19:30:18.901851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 19:30:20.129244 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:20.133617 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:30:20.164130 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 19:30:20.171491 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 19:30:20.207396 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:30:20.238306 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 19:30:20.245508 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 19:30:20.763853 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 19:30:20.769795 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 19:30:20.781097 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:30:20.825372 tst assert_extension.py: using LAC 23217 19:30:20.941880 tst assert_extension.py: using RAC 12 19:30:21.058459 tst assert_extension.py: using CellId 23217 19:30:21.177512 tst assert_extension.py: using BVCI 23218 19:30:21.297396 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 19:30:21.411086 tst assert_extension.py:10: start nitb and bts... 19:30:21.612524 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:30:22.224437 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6908): Launched 19:30:22.523221 run osmo-nitb_10.42.42.2(pid=6909): Launched 19:30:22.688618 run osmo-nitb_10.42.42.2(pid=6909): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6909)] 19:30:22.822086 run osmo-nitb_10.42.42.2(pid=6909): stdout: | (launched: 2022-12-09_19:30:22.468417) 19:30:22.956749 run osmo-nitb_10.42.42.2(pid=6909): stderr: | (launched: 2022-12-09_19:30:22.512792) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:30:23.091609 run osmo-nitb_10.42.42.2(pid=6909): stdout: | (launched: 2022-12-09_19:30:22.468417) 19:30:23.221274 run osmo-nitb_10.42.42.2(pid=6909): stderr: | (launched: 2022-12-09_19:30:22.512792) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6909) [trial-2363↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6909)] 19:30:23.635882 tst osmo-nitb_10.42.42.2(pid=6909): stdout: | (launched: 2022-12-09_19:30:22.468417) 19:30:23.755683 tst osmo-nitb_10.42.42.2(pid=6909): stderr: | (launched: 2022-12-09_19:30:22.512792) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:30:23.896773 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6909) [trial-2363↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6909)] [trial-2363↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 19:30:23.905195 tst assert_extension.py:12: Test FAILED (3.1 sec) 19:30:23.911805 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6908): Terminating (SIGTERM) 19:30:24.119709 --- ParallelTerminationStrategy: PID 6908 died... 19:30:24.140061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6908): Terminated: ok {rc=0} 19:30:24.225613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 19:30:25.398142 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:25.401937 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:30:25.431258 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:30:25.457280 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 19:30:25.492276 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:30:25.521694 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:30:25.547973 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 19:30:26.081149 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 19:30:26.086333 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.097458 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:30:26.143855 tst assert_extension.py: using LAC 23218 19:30:26.274859 tst assert_extension.py: using RAC 13 19:30:26.400482 tst assert_extension.py: using CellId 23218 19:30:26.523981 tst assert_extension.py: using BVCI 23219 19:30:26.639940 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.651122 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.662172 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.674461 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.686077 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:30:26.697683 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 19:30:26.811160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:27.273688 run create_hlr_db(pid=6914): Launched 19:30:27.396068 bus /sierra_2: Setting Powered False 19:30:28.455511 run create_hlr_db(pid=6914): Terminated: ok {rc=0} 19:30:28.891212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Launched 19:30:29.211855 run osmo-hlr_10.42.42.2(pid=6917): Launched 19:30:29.334495 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:29.886997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Launched 19:30:30.208024 run osmo-stp_10.42.42.5(pid=6920): Launched 19:30:30.332703 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:30.926897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6922): Launched 19:30:31.315213 run osmo-msc_10.42.42.6(pid=6923): Launched 19:30:31.820261 run osmo-stp_10.42.42.5(pid=6920): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] 19:30:32.204602 run osmo-stp_10.42.42.5(pid=6920): stdout: | (launched: 2022-12-09_19:30:30.148925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:32.444262 run osmo-stp_10.42.42.5(pid=6920): stderr: | [0;m[38;5;43m20221209193030338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193030338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193030339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193030339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193030339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193030339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193030340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:32.579698 run osmo-stp_10.42.42.5(pid=6920): stdout: | (launched: 2022-12-09_19:30:30.148925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:32.707816 run osmo-stp_10.42.42.5(pid=6920): stderr: | [0;m[38;5;43m20221209193030338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193030338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193030339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193030339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193030339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193030339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193030340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:32.860683 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6920): Process ended prematurely: osmo-stp_10.42.42.5(pid=6920) [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 19:30:32.869716 tst assert_extension.py:17: Test FAILED (6.8 sec) 19:30:32.897586 run osmo-hlr_10.42.42.2(pid=6917): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6917)] 19:30:32.947422 run osmo-hlr_10.42.42.2(pid=6917): stdout: | (launched: 2022-12-09_19:30:29.153309) 19:30:32.998851 run osmo-hlr_10.42.42.2(pid=6917): stderr: | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193029349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193029362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193029370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193029370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193029371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:33.070412 run osmo-msc_10.42.42.6(pid=6923): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6923)] 19:30:33.120176 run osmo-msc_10.42.42.6(pid=6923): stdout: | (launched: 2022-12-09_19:30:31.250856) 19:30:33.171461 run osmo-msc_10.42.42.6(pid=6923): stderr: | [0;m[38;5;43m20221209193031855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193031856 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72ef8ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193031856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193031856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193031858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193031859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193031865 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193031866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193031867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193031868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:33.223614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Terminating (SIGTERM) 19:30:33.265307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Terminating (SIGTERM) 19:30:33.306801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6922): Terminating (SIGTERM) 19:30:33.348844 --- ParallelTerminationStrategy: PID 6916 died... 19:30:33.368494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Terminated: ok {rc=0} 19:30:33.415335 --- ParallelTerminationStrategy: PID 6919 died... 19:30:33.435370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Terminated: ok {rc=0} 19:30:33.482341 --- ParallelTerminationStrategy: PID 6922 died... 19:30:33.501890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6922): Terminated: ok {rc=0} 19:30:33.589690 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:30:34.792184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:34.799529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:30:34.830018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:30:34.856915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:30:34.911355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:30:34.941607 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:30:34.968506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:30:35.519176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:30:35.572403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:35.584149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:30:35.651032 tst mo_mt_call.py: using LAC 23219 19:30:35.778124 tst mo_mt_call.py: using RAC 14 19:30:35.905468 tst mo_mt_call.py: using CellId 23219 19:30:36.024760 tst mo_mt_call.py: using BVCI 23220 19:30:36.133793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:36.144870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:36.155816 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:36.166739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:36.178029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:36.188871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:30:36.306968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:30:36.428734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:36.935615 run create_hlr_db(pid=6936): Launched 19:30:37.059991 bus /sierra_2: Setting Powered False 19:30:38.123918 run create_hlr_db(pid=6936): Terminated: ok {rc=0} 19:30:38.578166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Launched 19:30:38.904940 run osmo-hlr_10.42.42.2(pid=6939): Launched 19:30:39.031316 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:39.557583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Launched 19:30:39.865287 run osmo-stp_10.42.42.5(pid=6942): Launched 19:30:39.982662 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:40.532508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Launched 19:30:40.835837 run osmo-msc_10.42.42.6(pid=6945): Launched 19:30:41.004531 run osmo-stp_10.42.42.5(pid=6942): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] 19:30:41.133301 run osmo-stp_10.42.42.5(pid=6942): stdout: | (launched: 2022-12-09_19:30:39.808595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:41.260762 run osmo-stp_10.42.42.5(pid=6942): stderr: | [0;m[38;5;43m20221209193039981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193039982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193039982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193039982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:41.386895 run osmo-stp_10.42.42.5(pid=6942): stdout: | (launched: 2022-12-09_19:30:39.808595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:41.507591 run osmo-stp_10.42.42.5(pid=6942): stderr: | [0;m[38;5;43m20221209193039981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193039982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193039982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193039982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193039983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:41.651915 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6942): Process ended prematurely: osmo-stp_10.42.42.5(pid=6942) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:30:41.660773 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:30:41.686864 run osmo-hlr_10.42.42.2(pid=6939): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6939)] 19:30:41.733466 run osmo-hlr_10.42.42.2(pid=6939): stdout: | (launched: 2022-12-09_19:30:38.845623) 19:30:41.781642 run osmo-hlr_10.42.42.2(pid=6939): stderr: | [0;m[1;31m20221209193039045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193039046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193039046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193039046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193039046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193039046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193039058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193039066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193039066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193039067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:41.849100 run osmo-msc_10.42.42.6(pid=6945): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6945)] 19:30:41.895624 run osmo-msc_10.42.42.6(pid=6945): stdout: | (launched: 2022-12-09_19:30:40.780022) 19:30:41.943630 run osmo-msc_10.42.42.6(pid=6945): stderr: | [0;m[38;5;43m20221209193041051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193041051 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3fde5c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193041051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193041051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193041051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193041052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193041054 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193041055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193041055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193041055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:41.991985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Terminating (SIGTERM) 19:30:42.030635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Terminating (SIGTERM) 19:30:42.069466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Terminating (SIGTERM) 19:30:42.108679 --- ParallelTerminationStrategy: PID 6938 died... 19:30:42.127594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Terminated: ok {rc=0} 19:30:42.170674 --- ParallelTerminationStrategy: PID 6941 died... 19:30:42.188881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Terminated: ok {rc=0} 19:30:42.231801 --- ParallelTerminationStrategy: PID 6944 died... 19:30:42.250110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Terminated: ok {rc=0} 19:30:42.331131 bus /sierra_3: Setting Powered False 19:30:43.424115 bus /sierra_3: Setting Powered False 19:30:44.535930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:30:45.680897 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:45.692717 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:30:45.757376 tst mo_mt_call_osmux.py: using LAC 23220 19:30:45.906311 tst mo_mt_call_osmux.py: using RAC 15 19:30:46.037488 tst mo_mt_call_osmux.py: using CellId 23220 19:30:46.167759 tst mo_mt_call_osmux.py: using BVCI 23221 19:30:46.315350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:46.328636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:46.342782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:46.355778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:46.368687 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:30:46.381962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:30:46.530263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:30:46.671516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:47.199210 run create_hlr_db(pid=6947): Launched 19:30:47.329983 bus /sierra_2: Setting Powered False 19:30:48.391047 run create_hlr_db(pid=6947): Terminated: ok {rc=0} 19:30:48.818070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Launched 19:30:49.122435 run osmo-hlr_10.42.42.2(pid=6950): Launched 19:30:49.237065 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:49.759825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Launched 19:30:50.063776 run osmo-stp_10.42.42.5(pid=6953): Launched 19:30:50.179217 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:50.734160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Launched 19:30:51.038199 run osmo-msc_10.42.42.6(pid=6956): Launched 19:30:51.207925 run osmo-stp_10.42.42.5(pid=6953): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] 19:30:51.336070 run osmo-stp_10.42.42.5(pid=6953): stdout: | (launched: 2022-12-09_19:30:50.007804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:51.464160 run osmo-stp_10.42.42.5(pid=6953): stderr: | [0;m[38;5;43m20221209193050176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193050177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:51.590345 run osmo-stp_10.42.42.5(pid=6953): stdout: | (launched: 2022-12-09_19:30:50.007804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:51.710997 run osmo-stp_10.42.42.5(pid=6953): stderr: | [0;m[38;5;43m20221209193050176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193050177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193050178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:51.855753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6953): Process ended prematurely: osmo-stp_10.42.42.5(pid=6953) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:30:51.864602 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:30:51.890612 run osmo-hlr_10.42.42.2(pid=6950): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6950)] 19:30:51.937433 run osmo-hlr_10.42.42.2(pid=6950): stdout: | (launched: 2022-12-09_19:30:49.066378) 19:30:51.985604 run osmo-hlr_10.42.42.2(pid=6950): stderr: | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193049255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193049266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193049266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193049266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:52.053126 run osmo-msc_10.42.42.6(pid=6956): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6956)] 19:30:52.099508 run osmo-msc_10.42.42.6(pid=6956): stdout: | (launched: 2022-12-09_19:30:50.981990) 19:30:52.147934 run osmo-msc_10.42.42.6(pid=6956): stderr: | [0;m[38;5;43m20221209193051254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193051255 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfd5e7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193051255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193051255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193051255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193051255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193051258 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193051258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193051259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193051259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:52.196437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Terminating (SIGTERM) 19:30:52.235275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Terminating (SIGTERM) 19:30:52.273880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Terminating (SIGTERM) 19:30:52.312801 --- ParallelTerminationStrategy: PID 6949 died... 19:30:52.331674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Terminated: ok {rc=0} 19:30:52.374625 --- ParallelTerminationStrategy: PID 6952 died... 19:30:52.392878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Terminated: ok {rc=0} 19:30:52.435721 --- ParallelTerminationStrategy: PID 6955 died... 19:30:52.453986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Terminated: ok {rc=0} 19:30:52.537615 bus /sierra_3: Setting Powered False 19:30:53.635821 bus /sierra_3: Setting Powered False 19:30:54.749986 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:30:55.993583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:55.999778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:30:56.028364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:30:56.054277 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:30:56.109420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:30:56.138127 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:30:56.164565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:30:56.712489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:30:56.760938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:56.772112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:30:56.836429 tst mo_mt_call.py: using LAC 23221 19:30:56.963960 tst mo_mt_call.py: using RAC 16 19:30:57.091777 tst mo_mt_call.py: using CellId 23221 19:30:57.210804 tst mo_mt_call.py: using BVCI 23222 19:30:57.322170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:57.333359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:57.344242 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:57.355192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:57.366285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:30:57.377235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:30:57.495529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:30:57.611943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:58.085182 run create_hlr_db(pid=6961): Launched 19:30:58.209190 bus /sierra_2: Setting Powered False 19:30:59.269827 run create_hlr_db(pid=6961): Terminated: ok {rc=0} 19:30:59.694486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Launched 19:30:59.998708 run osmo-hlr_10.42.42.2(pid=6964): Launched 19:31:00.113887 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:00.654678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Launched 19:31:00.999087 run osmo-stp_10.42.42.5(pid=6967): Launched 19:31:01.292440 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:02.135142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Launched 19:31:02.476617 run osmo-msc_10.42.42.6(pid=6970): Launched 19:31:02.663217 run osmo-stp_10.42.42.5(pid=6967): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] 19:31:02.802851 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-09_19:31:00.934365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:02.941620 run osmo-stp_10.42.42.5(pid=6967): stderr: | [0;m[38;5;43m20221209193101376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193101377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193101377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193101379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193101382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193101383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193101383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:03.077726 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-09_19:31:00.934365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:03.207673 run osmo-stp_10.42.42.5(pid=6967): stderr: | [0;m[38;5;43m20221209193101376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193101377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193101377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193101379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193101382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193101383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193101383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:03.364122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:31:03.373713 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 19:31:03.401712 run osmo-hlr_10.42.42.2(pid=6964): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6964)] 19:31:03.451494 run osmo-hlr_10.42.42.2(pid=6964): stdout: | (launched: 2022-12-09_19:30:59.941945) 19:31:03.502661 run osmo-hlr_10.42.42.2(pid=6964): stderr: | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193100118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193100131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193100140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193100140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193100140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:03.574272 run osmo-msc_10.42.42.6(pid=6970): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6970)] 19:31:03.623679 run osmo-msc_10.42.42.6(pid=6970): stdout: | (launched: 2022-12-09_19:31:02.417189) 19:31:03.674706 run osmo-msc_10.42.42.6(pid=6970): stderr: | [0;m[38;5;43m20221209193102736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193102737 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00da613c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193102737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193102737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193102737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193102737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193102739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193102739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193102739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193102739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:03.726189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminating (SIGTERM) 19:31:03.767412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminating (SIGTERM) 19:31:03.809069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminating (SIGTERM) 19:31:03.851718 --- ParallelTerminationStrategy: PID 6963 died... 19:31:03.871885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminated: ok {rc=0} 19:31:03.918024 --- ParallelTerminationStrategy: PID 6966 died... 19:31:03.937388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminated: ok {rc=0} 19:31:03.983132 --- ParallelTerminationStrategy: PID 6969 died... 19:31:04.002603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminated: ok {rc=0} 19:31:04.089324 bus /sierra_3: Setting Powered False 19:31:05.185827 bus /sierra_3: Setting Powered False 19:31:06.298555 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:31:07.443408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:07.455496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:31:07.521103 tst mo_mt_call_osmux.py: using LAC 23222 19:31:07.641247 tst mo_mt_call_osmux.py: using RAC 17 19:31:07.762065 tst mo_mt_call_osmux.py: using CellId 23222 19:31:07.881688 tst mo_mt_call_osmux.py: using BVCI 23223 19:31:08.002270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:08.014111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:08.028089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:08.039617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:08.050654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:31:08.061729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:31:08.177415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:31:08.295539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:08.769130 run create_hlr_db(pid=6972): Launched 19:31:08.896618 bus /sierra_2: Setting Powered False 19:31:09.957612 run create_hlr_db(pid=6972): Terminated: ok {rc=0} 19:31:10.382472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Launched 19:31:10.686479 run osmo-hlr_10.42.42.2(pid=6975): Launched 19:31:10.802204 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:11.340560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Launched 19:31:11.644937 run osmo-stp_10.42.42.5(pid=6978): Launched 19:31:11.760498 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:12.311746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Launched 19:31:12.616403 run osmo-msc_10.42.42.6(pid=6981): Launched 19:31:12.786525 run osmo-stp_10.42.42.5(pid=6978): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] 19:31:12.915868 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-09_19:31:11.588633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:13.044183 run osmo-stp_10.42.42.5(pid=6978): stderr: | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193111761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:13.170666 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-09_19:31:11.588633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:13.291659 run osmo-stp_10.42.42.5(pid=6978): stderr: | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193111761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193111761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193111762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:13.436135 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:31:13.445078 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:31:13.471089 run osmo-hlr_10.42.42.2(pid=6975): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6975)] 19:31:13.517583 run osmo-hlr_10.42.42.2(pid=6975): stdout: | (launched: 2022-12-09_19:31:10.630676) 19:31:13.565489 run osmo-hlr_10.42.42.2(pid=6975): stderr: | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193110807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193110820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193110829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193110829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193110829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:13.632607 run osmo-msc_10.42.42.6(pid=6981): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6981)] 19:31:13.679065 run osmo-msc_10.42.42.6(pid=6981): stdout: | (launched: 2022-12-09_19:31:12.560291) 19:31:13.726805 run osmo-msc_10.42.42.6(pid=6981): stderr: | [0;m[38;5;43m20221209193112833 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193112833 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff28ce7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193112833 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193112833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193112834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193112834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193112835 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193112836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193112836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193112836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:13.775132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminating (SIGTERM) 19:31:13.813765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminating (SIGTERM) 19:31:13.852303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminating (SIGTERM) 19:31:13.891034 --- ParallelTerminationStrategy: PID 6974 died... 19:31:13.909781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminated: ok {rc=0} 19:31:13.952630 --- ParallelTerminationStrategy: PID 6977 died... 19:31:13.971058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminated: ok {rc=0} 19:31:14.013737 --- ParallelTerminationStrategy: PID 6980 died... 19:31:14.032043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminated: ok {rc=0} 19:31:14.115872 bus /sierra_3: Setting Powered False 19:31:15.214001 bus /sierra_3: Setting Powered False 19:31:16.330024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:31:17.582494 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:17.589653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:31:17.620082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:31:17.647201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:31:17.700081 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:31:17.729966 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:31:17.756831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:31:18.310777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:31:18.363068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.374686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:31:18.440881 tst mo_mt_call.py: using LAC 23223 19:31:18.566899 tst mo_mt_call.py: using RAC 18 19:31:18.692897 tst mo_mt_call.py: using CellId 23223 19:31:18.818948 tst mo_mt_call.py: using BVCI 23224 19:31:18.929804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.940903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.951949 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.963050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.974534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:18.985605 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:31:19.104887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:31:19.225286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:19.697359 run create_hlr_db(pid=6986): Launched 19:31:19.821207 bus /sierra_2: Setting Powered False 19:31:20.886199 run create_hlr_db(pid=6986): Terminated: ok {rc=0} 19:31:21.321756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Launched 19:31:21.626064 run osmo-hlr_10.42.42.2(pid=6989): Launched 19:31:21.741240 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:22.280888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Launched 19:31:22.584903 run osmo-stp_10.42.42.5(pid=6992): Launched 19:31:22.700611 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:23.255507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Launched 19:31:23.561537 run osmo-msc_10.42.42.6(pid=6995): Launched 19:31:23.733513 run osmo-stp_10.42.42.5(pid=6992): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] 19:31:23.862886 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-09_19:31:22.528893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:23.991376 run osmo-stp_10.42.42.5(pid=6992): stderr: | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193122701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:24.118480 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-09_19:31:22.528893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:24.239812 run osmo-stp_10.42.42.5(pid=6992): stderr: | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193122700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193122701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193122701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:24.385560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:31:24.394354 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:31:24.420383 run osmo-hlr_10.42.42.2(pid=6989): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6989)] 19:31:24.467247 run osmo-hlr_10.42.42.2(pid=6989): stdout: | (launched: 2022-12-09_19:31:21.570259) 19:31:24.515466 run osmo-hlr_10.42.42.2(pid=6989): stderr: | [0;m[1;31m20221209193121744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193121744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193121744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193121744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193121745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193121745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193121757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193121766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193121766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193121766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:24.583148 run osmo-msc_10.42.42.6(pid=6995): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6995)] 19:31:24.629660 run osmo-msc_10.42.42.6(pid=6995): stdout: | (launched: 2022-12-09_19:31:23.505122) 19:31:24.677923 run osmo-msc_10.42.42.6(pid=6995): stderr: | [0;m[38;5;43m20221209193123775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193123775 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb237fecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193123775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193123775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193123776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193123776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193123778 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193123778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193123779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193123779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:24.726309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminating (SIGTERM) 19:31:24.765082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminating (SIGTERM) 19:31:24.803741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminating (SIGTERM) 19:31:24.842669 --- ParallelTerminationStrategy: PID 6988 died... 19:31:24.861319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminated: ok {rc=0} 19:31:24.905244 --- ParallelTerminationStrategy: PID 6991 died... 19:31:24.923581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminated: ok {rc=0} 19:31:24.966323 --- ParallelTerminationStrategy: PID 6994 died... 19:31:24.984477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminated: ok {rc=0} 19:31:25.065099 bus /sierra_3: Setting Powered False 19:31:26.158203 bus /sierra_3: Setting Powered False 19:31:27.267893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:31:28.415189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:28.428053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:31:28.495258 tst mo_mt_call_osmux.py: using LAC 23224 19:31:28.622398 tst mo_mt_call_osmux.py: using RAC 19 19:31:28.750832 tst mo_mt_call_osmux.py: using CellId 23224 19:31:28.881657 tst mo_mt_call_osmux.py: using BVCI 23225 19:31:29.001301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:29.013012 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:29.024759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:29.036635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:29.048285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:31:29.059949 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:31:29.178010 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:31:29.299287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:29.806775 run create_hlr_db(pid=6997): Launched 19:31:29.932886 bus /sierra_2: Setting Powered False 19:31:30.996011 run create_hlr_db(pid=6997): Terminated: ok {rc=0} 19:31:31.489388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Launched 19:31:31.830115 run osmo-hlr_10.42.42.2(pid=7000): Launched 19:31:32.052498 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:32.627108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Launched 19:31:32.954501 run osmo-stp_10.42.42.5(pid=7003): Launched 19:31:33.081689 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:33.673914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7005): Launched 19:31:33.999205 run osmo-msc_10.42.42.6(pid=7006): Launched 19:31:34.179896 run osmo-stp_10.42.42.5(pid=7003): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] 19:31:34.317652 run osmo-stp_10.42.42.5(pid=7003): stdout: | (launched: 2022-12-09_19:31:32.894903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:34.454949 run osmo-stp_10.42.42.5(pid=7003): stderr: | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193133087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:34.592096 run osmo-stp_10.42.42.5(pid=7003): stdout: | (launched: 2022-12-09_19:31:32.894903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:34.722207 run osmo-stp_10.42.42.5(pid=7003): stderr: | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193133086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193133087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193133087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:34.877813 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7003): Process ended prematurely: osmo-stp_10.42.42.5(pid=7003) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:31:34.887410 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:31:34.915309 run osmo-hlr_10.42.42.2(pid=7000): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7000)] 19:31:34.965088 run osmo-hlr_10.42.42.2(pid=7000): stdout: | (launched: 2022-12-09_19:31:31.770576) 19:31:35.016184 run osmo-hlr_10.42.42.2(pid=7000): stderr: | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193132093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193132111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193132130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193132130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193132130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:35.087200 run osmo-msc_10.42.42.6(pid=7006): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7006)] 19:31:35.136555 run osmo-msc_10.42.42.6(pid=7006): stdout: | (launched: 2022-12-09_19:31:33.939755) 19:31:35.187421 run osmo-msc_10.42.42.6(pid=7006): stderr: | [0;m[38;5;43m20221209193134263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193134263 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efd3c0e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193134263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193134263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193134263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193134263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193134265 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193134266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193134266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193134266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:35.238888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Terminating (SIGTERM) 19:31:35.279865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Terminating (SIGTERM) 19:31:35.320672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7005): Terminating (SIGTERM) 19:31:35.362524 --- ParallelTerminationStrategy: PID 6999 died... 19:31:35.382143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Terminated: ok {rc=0} 19:31:35.427975 --- ParallelTerminationStrategy: PID 7002 died... 19:31:35.447198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Terminated: ok {rc=0} 19:31:35.493014 --- ParallelTerminationStrategy: PID 7005 died... 19:31:35.512251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7005): Terminated: ok {rc=0} 19:31:35.597782 bus /sierra_3: Setting Powered False 19:31:36.694083 bus /sierra_3: Setting Powered False 19:31:37.807240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:31:39.056146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:39.063177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:31:39.093560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:31:39.120392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:31:39.174253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:31:39.204775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:31:39.232515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:31:39.780303 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:31:39.829352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:39.840516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:31:39.905313 tst mo_mt_call.py: using LAC 23225 19:31:40.025193 tst mo_mt_call.py: using RAC 20 19:31:40.144143 tst mo_mt_call.py: using CellId 23225 19:31:40.264706 tst mo_mt_call.py: using BVCI 23226 19:31:40.375767 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:40.386926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:40.397905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:40.408792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:40.419850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:40.430750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:31:40.544082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:31:40.660072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:41.131042 run create_hlr_db(pid=7012): Launched 19:31:41.255147 bus /sierra_2: Setting Powered False 19:31:42.316650 run create_hlr_db(pid=7012): Terminated: ok {rc=0} 19:31:42.761362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7014): Launched 19:31:43.087400 run osmo-hlr_10.42.42.2(pid=7015): Launched 19:31:43.212727 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:43.772385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7017): Launched 19:31:44.097657 run osmo-stp_10.42.42.5(pid=7018): Launched 19:31:44.222662 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:44.811913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7020): Launched 19:31:45.140429 run osmo-msc_10.42.42.6(pid=7021): Launched 19:31:45.323346 run osmo-stp_10.42.42.5(pid=7018): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7018)] 19:31:45.460608 run osmo-stp_10.42.42.5(pid=7018): stdout: | (launched: 2022-12-09_19:31:44.038203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:45.598336 run osmo-stp_10.42.42.5(pid=7018): stderr: | [0;m[38;5;43m20221209193144230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193144230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193144231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193144231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:45.734796 run osmo-stp_10.42.42.5(pid=7018): stdout: | (launched: 2022-12-09_19:31:44.038203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:45.865891 run osmo-stp_10.42.42.5(pid=7018): stderr: | [0;m[38;5;43m20221209193144230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193144230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193144231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193144231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193144232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:46.029360 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7018): Process ended prematurely: osmo-stp_10.42.42.5(pid=7018) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7018)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:31:46.039905 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:31:46.069823 run osmo-hlr_10.42.42.2(pid=7015): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7015)] 19:31:46.120938 run osmo-hlr_10.42.42.2(pid=7015): stdout: | (launched: 2022-12-09_19:31:43.027871) 19:31:46.173952 run osmo-hlr_10.42.42.2(pid=7015): stderr: | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193143227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193143239 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193143248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193143248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193143248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:46.247701 run osmo-msc_10.42.42.6(pid=7021): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7021)] 19:31:46.299721 run osmo-msc_10.42.42.6(pid=7021): stdout: | (launched: 2022-12-09_19:31:45.080870) 19:31:46.353254 run osmo-msc_10.42.42.6(pid=7021): stderr: | [0;m[38;5;43m20221209193145402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193145403 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ddfaf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193145403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193145403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193145403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193145403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193145405 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193145405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193145405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193145406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:46.406805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7014): Terminating (SIGTERM) 19:31:46.450144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7017): Terminating (SIGTERM) 19:31:46.493598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7020): Terminating (SIGTERM) 19:31:46.537340 --- ParallelTerminationStrategy: PID 7014 died... 19:31:46.557704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7014): Terminated: ok {rc=0} 19:31:46.606429 --- ParallelTerminationStrategy: PID 7017 died... 19:31:46.626815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7017): Terminated: ok {rc=0} 19:31:46.675593 --- ParallelTerminationStrategy: PID 7020 died... 19:31:46.695951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7020): Terminated: ok {rc=0} 19:31:46.786524 bus /sierra_3: Setting Powered False 19:31:47.883832 bus /sierra_3: Setting Powered False 19:31:48.996907 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:31:50.141336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.153196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:31:50.217478 tst mo_mt_call_osmux.py: using LAC 23226 19:31:50.345237 tst mo_mt_call_osmux.py: using RAC 21 19:31:50.472194 tst mo_mt_call_osmux.py: using CellId 23226 19:31:50.598379 tst mo_mt_call_osmux.py: using BVCI 23227 19:31:50.716756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.728680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.740230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.751956 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.763714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:31:50.775485 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:31:50.892707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:31:51.008437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:51.516942 run create_hlr_db(pid=7023): Launched 19:31:51.642939 bus /sierra_2: Setting Powered False 19:31:52.707837 run create_hlr_db(pid=7023): Terminated: ok {rc=0} 19:31:53.145806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7025): Launched 19:31:53.450596 run osmo-hlr_10.42.42.2(pid=7026): Launched 19:31:53.566590 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:54.092475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7028): Launched 19:31:54.398526 run osmo-stp_10.42.42.5(pid=7029): Launched 19:31:54.514136 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:55.065567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7031): Launched 19:31:55.370930 run osmo-msc_10.42.42.6(pid=7032): Launched 19:31:55.541274 run osmo-stp_10.42.42.5(pid=7029): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7029)] 19:31:55.669711 run osmo-stp_10.42.42.5(pid=7029): stdout: | (launched: 2022-12-09_19:31:54.342333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:55.797946 run osmo-stp_10.42.42.5(pid=7029): stderr: | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193154514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:55.924113 run osmo-stp_10.42.42.5(pid=7029): stdout: | (launched: 2022-12-09_19:31:54.342333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:56.045117 run osmo-stp_10.42.42.5(pid=7029): stderr: | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193154513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193154514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193154514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:56.190190 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7029): Process ended prematurely: osmo-stp_10.42.42.5(pid=7029) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7029)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:31:56.198934 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:31:56.225146 run osmo-hlr_10.42.42.2(pid=7026): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7026)] 19:31:56.272329 run osmo-hlr_10.42.42.2(pid=7026): stdout: | (launched: 2022-12-09_19:31:53.394375) 19:31:56.321229 run osmo-hlr_10.42.42.2(pid=7026): stderr: | [0;m[1;31m20221209193153569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193153569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193153569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193153570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193153570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193153570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193153582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193153590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193153591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193153591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:56.389374 run osmo-msc_10.42.42.6(pid=7032): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7032)] 19:31:56.436430 run osmo-msc_10.42.42.6(pid=7032): stdout: | (launched: 2022-12-09_19:31:55.314995) 19:31:56.484925 run osmo-msc_10.42.42.6(pid=7032): stderr: | [0;m[38;5;43m20221209193155588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193155588 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9ccf43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193155588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193155588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193155588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193155588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193155590 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193155591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193155591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193155591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:56.533814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7025): Terminating (SIGTERM) 19:31:56.572465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7028): Terminating (SIGTERM) 19:31:56.611254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7031): Terminating (SIGTERM) 19:31:56.650410 --- ParallelTerminationStrategy: PID 7025 died... 19:31:56.669321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7025): Terminated: ok {rc=0} 19:31:56.712757 --- ParallelTerminationStrategy: PID 7028 died... 19:31:56.731240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7028): Terminated: ok {rc=0} 19:31:56.774238 --- ParallelTerminationStrategy: PID 7031 died... 19:31:56.792665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7031): Terminated: ok {rc=0} 19:31:56.878473 bus /sierra_3: Setting Powered False 19:31:57.977510 bus /sierra_3: Setting Powered False 19:31:59.093043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:32:00.335467 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:00.342149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:32:00.370574 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:32:00.396642 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:32:00.447084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:32:00.475578 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:32:00.501838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:32:01.057805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:32:01.108602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.120323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:32:01.185270 tst mo_mt_call.py: using LAC 23227 19:32:01.319937 tst mo_mt_call.py: using RAC 22 19:32:01.463105 tst mo_mt_call.py: using CellId 23227 19:32:01.624097 tst mo_mt_call.py: using BVCI 23228 19:32:01.746182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.759053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.771522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.785777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.800393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:01.814059 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:32:01.941831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:32:02.075597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:02.553182 run create_hlr_db(pid=7037): Launched 19:32:02.685903 bus /sierra_2: Setting Powered False 19:32:03.746335 run create_hlr_db(pid=7037): Terminated: ok {rc=0} 19:32:04.171454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7039): Launched 19:32:04.476371 run osmo-hlr_10.42.42.2(pid=7040): Launched 19:32:04.591261 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:05.128493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7042): Launched 19:32:05.433296 run osmo-stp_10.42.42.5(pid=7043): Launched 19:32:05.548174 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:06.098272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7045): Launched 19:32:06.403311 run osmo-msc_10.42.42.6(pid=7046): Launched 19:32:06.573110 run osmo-stp_10.42.42.5(pid=7043): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7043)] 19:32:06.702072 run osmo-stp_10.42.42.5(pid=7043): stdout: | (launched: 2022-12-09_19:32:05.377476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:06.830765 run osmo-stp_10.42.42.5(pid=7043): stderr: | [0;m[38;5;43m20221209193205546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193205546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193205547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193205547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193205547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193205548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193205548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:06.956817 run osmo-stp_10.42.42.5(pid=7043): stdout: | (launched: 2022-12-09_19:32:05.377476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:07.077945 run osmo-stp_10.42.42.5(pid=7043): stderr: | [0;m[38;5;43m20221209193205546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193205546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193205547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193205547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193205547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193205548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193205548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:07.223831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7043): Process ended prematurely: osmo-stp_10.42.42.5(pid=7043) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7043)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:32:07.232853 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:32:07.258910 run osmo-hlr_10.42.42.2(pid=7040): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7040)] 19:32:07.305270 run osmo-hlr_10.42.42.2(pid=7040): stdout: | (launched: 2022-12-09_19:32:04.420129) 19:32:07.353444 run osmo-hlr_10.42.42.2(pid=7040): stderr: | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193204598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193204610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193204620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193204620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193204620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:07.420842 run osmo-msc_10.42.42.6(pid=7046): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7046)] 19:32:07.467070 run osmo-msc_10.42.42.6(pid=7046): stdout: | (launched: 2022-12-09_19:32:06.346992) 19:32:07.515008 run osmo-msc_10.42.42.6(pid=7046): stderr: | [0;m[38;5;43m20221209193206620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193206620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f852a11dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193206620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193206621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193206621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193206621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193206624 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193206624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193206624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193206624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:07.563275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7039): Terminating (SIGTERM) 19:32:07.601994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7042): Terminating (SIGTERM) 19:32:07.640577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7045): Terminating (SIGTERM) 19:32:07.679426 --- ParallelTerminationStrategy: PID 7039 died... 19:32:07.698106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7039): Terminated: ok {rc=0} 19:32:07.741141 --- ParallelTerminationStrategy: PID 7042 died... 19:32:07.759332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7042): Terminated: ok {rc=0} 19:32:07.802130 --- ParallelTerminationStrategy: PID 7045 died... 19:32:07.820505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7045): Terminated: ok {rc=0} 19:32:07.901898 bus /sierra_3: Setting Powered False 19:32:08.998100 bus /sierra_3: Setting Powered False 19:32:10.113655 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:32:11.262358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.274896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:32:11.343798 tst mo_mt_call_osmux.py: using LAC 23228 19:32:11.465698 tst mo_mt_call_osmux.py: using RAC 23 19:32:11.584852 tst mo_mt_call_osmux.py: using CellId 23228 19:32:11.714964 tst mo_mt_call_osmux.py: using BVCI 23229 19:32:11.833908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.845737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.857475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.870519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.883200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:32:11.894834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:32:12.013538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:32:12.133227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:12.640055 run create_hlr_db(pid=7048): Launched 19:32:12.765570 bus /sierra_2: Setting Powered False 19:32:13.830097 run create_hlr_db(pid=7048): Terminated: ok {rc=0} 19:32:14.283118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7050): Launched 19:32:14.609677 run osmo-hlr_10.42.42.2(pid=7051): Launched 19:32:14.735746 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:15.298622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7053): Launched 19:32:15.626504 run osmo-stp_10.42.42.5(pid=7054): Launched 19:32:15.750008 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:16.407407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7056): Launched 19:32:16.747511 run osmo-msc_10.42.42.6(pid=7057): Launched 19:32:17.157932 run osmo-stp_10.42.42.5(pid=7054): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7054)] 19:32:17.400871 run osmo-stp_10.42.42.5(pid=7054): stdout: | (launched: 2022-12-09_19:32:15.566770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:17.528940 run osmo-stp_10.42.42.5(pid=7054): stderr: | [0;m[38;5;43m20221209193215758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193215758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193215759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193215759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:17.655867 run osmo-stp_10.42.42.5(pid=7054): stdout: | (launched: 2022-12-09_19:32:15.566770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:17.776930 run osmo-stp_10.42.42.5(pid=7054): stderr: | [0;m[38;5;43m20221209193215758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193215758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193215759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193215759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193215760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:17.922320 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7054): Process ended prematurely: osmo-stp_10.42.42.5(pid=7054) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7054)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:32:17.931195 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 19:32:17.957576 run osmo-hlr_10.42.42.2(pid=7051): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7051)] 19:32:18.004554 run osmo-hlr_10.42.42.2(pid=7051): stdout: | (launched: 2022-12-09_19:32:14.550193) 19:32:18.052936 run osmo-hlr_10.42.42.2(pid=7051): stderr: | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193214748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193214761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193214769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193214770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193214770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:18.121210 run osmo-msc_10.42.42.6(pid=7057): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7057)] 19:32:18.167894 run osmo-msc_10.42.42.6(pid=7057): stdout: | (launched: 2022-12-09_19:32:16.690936) 19:32:18.216325 run osmo-msc_10.42.42.6(pid=7057): stderr: | [0;m[38;5;43m20221209193217146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193217147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f9db7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193217147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193217147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193217147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193217148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193217153 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193217153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193217154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193217154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:18.265156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7050): Terminating (SIGTERM) 19:32:18.304116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7053): Terminating (SIGTERM) 19:32:18.343026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7056): Terminating (SIGTERM) 19:32:18.382575 --- ParallelTerminationStrategy: PID 7050 died... 19:32:18.401433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7050): Terminated: ok {rc=0} 19:32:18.444675 --- ParallelTerminationStrategy: PID 7053 died... 19:32:18.463194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7053): Terminated: ok {rc=0} 19:32:18.506431 --- ParallelTerminationStrategy: PID 7056 died... 19:32:18.525015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7056): Terminated: ok {rc=0} 19:32:18.607320 bus /sierra_3: Setting Powered False 19:32:19.703923 bus /sierra_3: Setting Powered False 19:32:20.821459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:32:22.067649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:22.076372 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:32:22.106913 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:32:22.134072 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:32:22.186938 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:32:22.215550 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:32:22.241681 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:32:22.797737 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:32:22.851159 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:22.863148 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:32:22.928385 tst mo_mt_call.py: using LAC 23229 19:32:23.053361 tst mo_mt_call.py: using RAC 24 19:32:23.178271 tst mo_mt_call.py: using CellId 23229 19:32:23.304169 tst mo_mt_call.py: using BVCI 23230 19:32:23.422336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:23.434196 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:23.445730 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:23.457471 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:23.469306 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:23.481108 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:32:23.595887 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:32:23.714976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:24.222502 run create_hlr_db(pid=7062): Launched 19:32:24.346908 bus /sierra_2: Setting Powered False 19:32:25.410920 run create_hlr_db(pid=7062): Terminated: ok {rc=0} 19:32:25.847849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7064): Launched 19:32:26.152401 run osmo-hlr_10.42.42.2(pid=7065): Launched 19:32:26.267908 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:26.797668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7067): Launched 19:32:27.101717 run osmo-stp_10.42.42.5(pid=7068): Launched 19:32:27.217142 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:27.769638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7070): Launched 19:32:28.074284 run osmo-msc_10.42.42.6(pid=7071): Launched 19:32:28.245839 run osmo-stp_10.42.42.5(pid=7068): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7068)] 19:32:28.374370 run osmo-stp_10.42.42.5(pid=7068): stdout: | (launched: 2022-12-09_19:32:27.045417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:28.502356 run osmo-stp_10.42.42.5(pid=7068): stderr: | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193227215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:28.628783 run osmo-stp_10.42.42.5(pid=7068): stdout: | (launched: 2022-12-09_19:32:27.045417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:28.749794 run osmo-stp_10.42.42.5(pid=7068): stderr: | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193227214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193227215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193227215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:28.894929 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7068): Process ended prematurely: osmo-stp_10.42.42.5(pid=7068) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7068)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:32:28.903690 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:32:28.929750 run osmo-hlr_10.42.42.2(pid=7065): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7065)] 19:32:28.976142 run osmo-hlr_10.42.42.2(pid=7065): stdout: | (launched: 2022-12-09_19:32:26.096146) 19:32:29.024027 run osmo-hlr_10.42.42.2(pid=7065): stderr: | [0;m[1;31m20221209193226273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193226274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193226274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193226274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193226274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193226274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193226286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193226294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193226295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193226295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:29.091319 run osmo-msc_10.42.42.6(pid=7071): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7071)] 19:32:29.137658 run osmo-msc_10.42.42.6(pid=7071): stdout: | (launched: 2022-12-09_19:32:28.018021) 19:32:29.185387 run osmo-msc_10.42.42.6(pid=7071): stderr: | [0;m[38;5;43m20221209193228290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193228290 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0519ac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193228290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193228290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193228290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193228291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193228292 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193228293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193228293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193228293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:29.233531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7064): Terminating (SIGTERM) 19:32:29.271957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7067): Terminating (SIGTERM) 19:32:29.310269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7070): Terminating (SIGTERM) 19:32:29.349168 --- ParallelTerminationStrategy: PID 7064 died... 19:32:29.367808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7064): Terminated: ok {rc=0} 19:32:29.411204 --- ParallelTerminationStrategy: PID 7067 died... 19:32:29.429624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7067): Terminated: ok {rc=0} 19:32:29.472345 --- ParallelTerminationStrategy: PID 7070 died... 19:32:29.490663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7070): Terminated: ok {rc=0} 19:32:29.574567 bus /sierra_3: Setting Powered False 19:32:30.671021 bus /sierra_3: Setting Powered False 19:32:31.791841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:32:32.944321 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:32.956393 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:32:33.021683 tst mo_mt_call_osmux.py: using LAC 23230 19:32:33.140813 tst mo_mt_call_osmux.py: using RAC 25 19:32:33.268555 tst mo_mt_call_osmux.py: using CellId 23230 19:32:33.395467 tst mo_mt_call_osmux.py: using BVCI 23231 19:32:33.514196 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:33.526191 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:33.537812 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:33.549946 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:33.561852 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:32:33.573589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:32:33.690982 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:32:33.806839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:34.282818 run create_hlr_db(pid=7073): Launched 19:32:34.407143 bus /sierra_2: Setting Powered False 19:32:35.468448 run create_hlr_db(pid=7073): Terminated: ok {rc=0} 19:32:35.916342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7076): Launched 19:32:36.223588 run osmo-hlr_10.42.42.2(pid=7077): Launched 19:32:36.339070 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:36.869686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7079): Launched 19:32:37.174809 run osmo-stp_10.42.42.5(pid=7080): Launched 19:32:37.290095 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:37.841784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7082): Launched 19:32:38.146234 run osmo-msc_10.42.42.6(pid=7083): Launched 19:32:38.316099 run osmo-stp_10.42.42.5(pid=7080): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7080)] 19:32:38.444337 run osmo-stp_10.42.42.5(pid=7080): stdout: | (launched: 2022-12-09_19:32:37.118607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:38.572657 run osmo-stp_10.42.42.5(pid=7080): stderr: | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193237291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:38.699066 run osmo-stp_10.42.42.5(pid=7080): stdout: | (launched: 2022-12-09_19:32:37.118607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:38.819856 run osmo-stp_10.42.42.5(pid=7080): stderr: | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193237290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193237291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193237291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:38.964419 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7080): Process ended prematurely: osmo-stp_10.42.42.5(pid=7080) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7080)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:32:38.973316 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:32:38.999531 run osmo-hlr_10.42.42.2(pid=7077): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7077)] 19:32:39.046250 run osmo-hlr_10.42.42.2(pid=7077): stdout: | (launched: 2022-12-09_19:32:36.166460) 19:32:39.094782 run osmo-hlr_10.42.42.2(pid=7077): stderr: | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193236343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193236355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193236364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193236364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193236365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:39.162837 run osmo-msc_10.42.42.6(pid=7083): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7083)] 19:32:39.209713 run osmo-msc_10.42.42.6(pid=7083): stdout: | (launched: 2022-12-09_19:32:38.090266) 19:32:39.258001 run osmo-msc_10.42.42.6(pid=7083): stderr: | [0;m[38;5;43m20221209193238361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193238361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2303b83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193238362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193238362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193238362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193238362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193238364 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193238364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193238364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193238364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:39.306600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7076): Terminating (SIGTERM) 19:32:39.345637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7079): Terminating (SIGTERM) 19:32:39.384539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7082): Terminating (SIGTERM) 19:32:39.423804 --- ParallelTerminationStrategy: PID 7076 died... 19:32:39.442668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7076): Terminated: ok {rc=0} 19:32:39.486302 --- ParallelTerminationStrategy: PID 7079 died... 19:32:39.504865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7079): Terminated: ok {rc=0} 19:32:39.547911 --- ParallelTerminationStrategy: PID 7082 died... 19:32:39.566312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7082): Terminated: ok {rc=0} 19:32:39.653107 bus /sierra_3: Setting Powered False 19:32:40.753227 bus /sierra_3: Setting Powered False 19:32:41.868840 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:32:43.120515 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:43.126917 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:32:43.157588 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:32:43.184466 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:32:43.236366 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:32:43.266743 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:32:43.294189 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:32:43.842699 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:32:43.892121 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:43.903411 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:32:43.969465 tst mo_mt_call.py: using LAC 23231 19:32:44.090228 tst mo_mt_call.py: using RAC 26 19:32:44.211970 tst mo_mt_call.py: using CellId 23231 19:32:44.333164 tst mo_mt_call.py: using BVCI 23232 19:32:44.442870 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:44.453985 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:44.464857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:44.475874 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:44.486747 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:44.497630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:32:44.615147 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:32:44.730402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:45.204853 run create_hlr_db(pid=7088): Launched 19:32:45.329801 bus /sierra_2: Setting Powered False 19:32:46.397464 run create_hlr_db(pid=7088): Terminated: ok {rc=0} 19:32:46.833320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Launched 19:32:47.145882 run osmo-hlr_10.42.42.2(pid=7091): Launched 19:32:47.307272 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:47.845676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Launched 19:32:48.149699 run osmo-stp_10.42.42.5(pid=7094): Launched 19:32:48.264396 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:48.813249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7096): Launched 19:32:49.119977 run osmo-msc_10.42.42.6(pid=7097): Launched 19:32:49.290458 run osmo-stp_10.42.42.5(pid=7094): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] 19:32:49.419277 run osmo-stp_10.42.42.5(pid=7094): stdout: | (launched: 2022-12-09_19:32:48.093744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:49.548242 run osmo-stp_10.42.42.5(pid=7094): stderr: | [0;m[38;5;43m20221209193248265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193248265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193248266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193248266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:49.674952 run osmo-stp_10.42.42.5(pid=7094): stdout: | (launched: 2022-12-09_19:32:48.093744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:49.795634 run osmo-stp_10.42.42.5(pid=7094): stderr: | [0;m[38;5;43m20221209193248265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193248265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193248266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193248266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193248267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:49.940401 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7094): Process ended prematurely: osmo-stp_10.42.42.5(pid=7094) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:32:49.949199 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:32:49.975222 run osmo-hlr_10.42.42.2(pid=7091): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7091)] 19:32:50.021678 run osmo-hlr_10.42.42.2(pid=7091): stdout: | (launched: 2022-12-09_19:32:47.088166) 19:32:50.069977 run osmo-hlr_10.42.42.2(pid=7091): stderr: | [0;m[1;31m20221209193247296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193247296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193247296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193247296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193247296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193247297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193247307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193247316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193247316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193247316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:50.137327 run osmo-msc_10.42.42.6(pid=7097): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7097)] 19:32:50.183770 run osmo-msc_10.42.42.6(pid=7097): stdout: | (launched: 2022-12-09_19:32:49.063763) 19:32:50.231851 run osmo-msc_10.42.42.6(pid=7097): stderr: | [0;m[38;5;43m20221209193249336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193249336 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f1f743c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193249336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193249336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193249336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193249337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193249338 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193249339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193249339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193249339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:50.280080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminating (SIGTERM) 19:32:50.318609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Terminating (SIGTERM) 19:32:50.357137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7096): Terminating (SIGTERM) 19:32:50.396144 --- ParallelTerminationStrategy: PID 7090 died... 19:32:50.414852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminated: ok {rc=0} 19:32:50.458015 --- ParallelTerminationStrategy: PID 7093 died... 19:32:50.476136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Terminated: ok {rc=0} 19:32:50.519213 --- ParallelTerminationStrategy: PID 7096 died... 19:32:50.537563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7096): Terminated: ok {rc=0} 19:32:50.623045 bus /sierra_3: Setting Powered False 19:32:51.721789 bus /sierra_3: Setting Powered False 19:32:52.835384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:32:53.980311 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:53.992074 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:32:54.058491 tst mo_mt_call_osmux.py: using LAC 23232 19:32:54.180256 tst mo_mt_call_osmux.py: using RAC 27 19:32:54.299864 tst mo_mt_call_osmux.py: using CellId 23232 19:32:54.420402 tst mo_mt_call_osmux.py: using BVCI 23233 19:32:54.530486 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:54.541764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:54.552515 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:54.563397 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:54.574332 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:32:54.585128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:32:54.702926 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:32:54.819768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:55.293491 run create_hlr_db(pid=7099): Launched 19:32:55.416712 bus /sierra_2: Setting Powered False 19:32:56.477613 run create_hlr_db(pid=7099): Terminated: ok {rc=0} 19:32:56.924455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7101): Launched 19:32:57.250502 run osmo-hlr_10.42.42.2(pid=7102): Launched 19:32:57.377273 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:57.940651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7104): Launched 19:32:58.266511 run osmo-stp_10.42.42.5(pid=7105): Launched 19:32:58.392839 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:58.981549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7107): Launched 19:32:59.309410 run osmo-msc_10.42.42.6(pid=7108): Launched 19:32:59.491721 run osmo-stp_10.42.42.5(pid=7105): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7105)] 19:32:59.629968 run osmo-stp_10.42.42.5(pid=7105): stdout: | (launched: 2022-12-09_19:32:58.207174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:59.768141 run osmo-stp_10.42.42.5(pid=7105): stderr: | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193258399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:59.905742 run osmo-stp_10.42.42.5(pid=7105): stdout: | (launched: 2022-12-09_19:32:58.207174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:00.035765 run osmo-stp_10.42.42.5(pid=7105): stderr: | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193258398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193258399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193258399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:00.191782 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7105): Process ended prematurely: osmo-stp_10.42.42.5(pid=7105) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7105)] [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:33:00.201698 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:33:00.229938 run osmo-hlr_10.42.42.2(pid=7102): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7102)] 19:33:00.280371 run osmo-hlr_10.42.42.2(pid=7102): stdout: | (launched: 2022-12-09_19:32:57.191014) 19:33:00.332103 run osmo-hlr_10.42.42.2(pid=7102): stderr: | [0;m[1;31m20221209193257388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193257388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193257388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193257389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193257389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193257389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193257401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193257410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193257410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193257410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:00.404045 run osmo-msc_10.42.42.6(pid=7108): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7108)] 19:33:00.453760 run osmo-msc_10.42.42.6(pid=7108): stdout: | (launched: 2022-12-09_19:32:59.249185) 19:33:00.505204 run osmo-msc_10.42.42.6(pid=7108): stderr: | [0;m[38;5;43m20221209193259571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193259571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb253014c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193259571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193259571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193259571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193259571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193259573 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193259574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193259574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193259574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:00.557287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7101): Terminating (SIGTERM) 19:33:00.598880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7104): Terminating (SIGTERM) 19:33:00.640551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7107): Terminating (SIGTERM) 19:33:00.682502 --- ParallelTerminationStrategy: PID 7101 died... 19:33:00.702413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7101): Terminated: ok {rc=0} 19:33:00.748746 --- ParallelTerminationStrategy: PID 7104 died... 19:33:00.768119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7104): Terminated: ok {rc=0} 19:33:00.814538 --- ParallelTerminationStrategy: PID 7107 died... 19:33:00.841053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7107): Terminated: ok {rc=0} 19:33:00.934789 bus /sierra_3: Setting Powered False 19:33:02.034326 bus /sierra_3: Setting Powered False 19:33:03.149139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 19:33:04.393829 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:04.398197 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:33:04.426807 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:33:04.453203 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 19:33:04.534844 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:33:04.563306 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:33:04.589336 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 19:33:05.175074 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 19:33:05.180025 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.190796 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:33:05.234928 tst emergency_mo_mt_call.py: using LAC 23233 19:33:05.350289 tst emergency_mo_mt_call.py: using RAC 28 19:33:05.465344 tst emergency_mo_mt_call.py: using CellId 23233 19:33:05.583613 tst emergency_mo_mt_call.py: using BVCI 23234 19:33:05.692259 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.703198 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.713883 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.724340 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.734850 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:05.745358 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:05.861914 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:05.978129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:06.444659 run create_hlr_db(pid=7114): Launched 19:33:06.567324 bus /sierra_2: Setting Powered False 19:33:07.627568 run create_hlr_db(pid=7114): Terminated: ok {rc=0} 19:33:08.067467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Launched 19:33:08.390165 run osmo-hlr_10.42.42.2(pid=7117): Launched 19:33:08.514870 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:09.070577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Launched 19:33:09.393622 run osmo-stp_10.42.42.5(pid=7120): Launched 19:33:09.530965 tst emergency_mo_mt_call.py: using MSISDN 7339 19:33:09.695057 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:10.275532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7122): Launched 19:33:10.598418 run osmo-msc_10.42.42.6(pid=7123): Launched 19:33:10.779175 run osmo-stp_10.42.42.5(pid=7120): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] 19:33:10.915027 run osmo-stp_10.42.42.5(pid=7120): stdout: | (launched: 2022-12-09_19:33:09.334706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:11.051321 run osmo-stp_10.42.42.5(pid=7120): stderr: | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193309527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:11.186745 run osmo-stp_10.42.42.5(pid=7120): stdout: | (launched: 2022-12-09_19:33:09.334706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:11.315373 run osmo-stp_10.42.42.5(pid=7120): stderr: | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193309526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193309527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193309527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:11.469176 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7120): Process ended prematurely: osmo-stp_10.42.42.5(pid=7120) [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 19:33:11.478300 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 19:33:11.506322 run osmo-hlr_10.42.42.2(pid=7117): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7117)] 19:33:11.556069 run osmo-hlr_10.42.42.2(pid=7117): stdout: | (launched: 2022-12-09_19:33:08.331166) 19:33:11.607404 run osmo-hlr_10.42.42.2(pid=7117): stderr: | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193308528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193308541 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193308550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193308550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193308550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:11.678972 run osmo-msc_10.42.42.6(pid=7123): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7123)] 19:33:11.728299 run osmo-msc_10.42.42.6(pid=7123): stdout: | (launched: 2022-12-09_19:33:10.539611) 19:33:11.779514 run osmo-msc_10.42.42.6(pid=7123): stderr: | [0;m[38;5;43m20221209193310862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193310862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4fc4d3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193310862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193310862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193310863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193310863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193310865 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193310865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193310865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193310865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:11.831140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Terminating (SIGTERM) 19:33:11.872495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Terminating (SIGTERM) 19:33:11.914302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7122): Terminating (SIGTERM) 19:33:11.955929 --- ParallelTerminationStrategy: PID 7116 died... 19:33:11.975785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Terminated: ok {rc=0} 19:33:12.022118 --- ParallelTerminationStrategy: PID 7119 died... 19:33:12.041602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Terminated: ok {rc=0} 19:33:12.087672 --- ParallelTerminationStrategy: PID 7122 died... 19:33:12.106959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7122): Terminated: ok {rc=0} 19:33:12.194331 bus /sierra_3: Setting Powered False 19:33:13.292371 bus /sierra_3: Setting Powered False 19:33:14.406458 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 19:33:15.489806 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:15.501290 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:33:15.548551 tst emergency_preemptive_call.py: using LAC 23234 19:33:15.670518 tst emergency_preemptive_call.py: using RAC 29 19:33:15.791058 tst emergency_preemptive_call.py: using CellId 23234 19:33:15.947142 tst emergency_preemptive_call.py: using BVCI 23235 19:33:16.070543 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:16.083001 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:16.095265 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:16.109126 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:16.123368 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:33:16.136593 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:16.284018 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:16.406052 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:16.522087 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:16.639224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:17.167627 run create_hlr_db(pid=7125): Launched 19:33:17.320653 bus /sierra_2: Setting Powered False 19:33:18.385082 run create_hlr_db(pid=7125): Terminated: ok {rc=0} 19:33:18.813473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Launched 19:33:19.112613 run osmo-hlr_10.42.42.2(pid=7128): Launched 19:33:19.226513 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:19.746058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Launched 19:33:20.046327 run osmo-stp_10.42.42.5(pid=7131): Launched 19:33:20.170757 tst emergency_preemptive_call.py: using MSISDN 7340 19:33:20.326672 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:20.864532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7133): Launched 19:33:21.163321 run osmo-msc_10.42.42.6(pid=7134): Launched 19:33:21.330779 run osmo-stp_10.42.42.5(pid=7131): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] 19:33:21.457107 run osmo-stp_10.42.42.5(pid=7131): stdout: | (launched: 2022-12-09_19:33:19.990815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:21.583224 run osmo-stp_10.42.42.5(pid=7131): stderr: | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193320163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:21.707274 run osmo-stp_10.42.42.5(pid=7131): stdout: | (launched: 2022-12-09_19:33:19.990815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:21.827509 run osmo-stp_10.42.42.5(pid=7131): stderr: | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193320162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193320163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193320164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:21.970215 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7131): Process ended prematurely: osmo-stp_10.42.42.5(pid=7131) [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 19:33:21.978547 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:33:22.004343 run osmo-hlr_10.42.42.2(pid=7128): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7128)] 19:33:22.051058 run osmo-hlr_10.42.42.2(pid=7128): stdout: | (launched: 2022-12-09_19:33:19.057097) 19:33:22.100069 run osmo-hlr_10.42.42.2(pid=7128): stderr: | [0;m[1;31m20221209193319231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193319231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193319231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193319231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193319231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193319232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193319244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193319253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193319253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193319253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:22.167594 run osmo-msc_10.42.42.6(pid=7134): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7134)] 19:33:22.214238 run osmo-msc_10.42.42.6(pid=7134): stdout: | (launched: 2022-12-09_19:33:21.108076) 19:33:22.262394 run osmo-msc_10.42.42.6(pid=7134): stderr: | [0;m[38;5;43m20221209193321379 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193321380 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c56b29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193321380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193321380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193321380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193321380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193321383 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193321384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193321384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193321384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:22.310915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Terminating (SIGTERM) 19:33:22.349882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Terminating (SIGTERM) 19:33:22.388547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7133): Terminating (SIGTERM) 19:33:22.427543 --- ParallelTerminationStrategy: PID 7127 died... 19:33:22.446300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Terminated: ok {rc=0} 19:33:22.489237 --- ParallelTerminationStrategy: PID 7130 died... 19:33:22.507427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Terminated: ok {rc=0} 19:33:22.550537 --- ParallelTerminationStrategy: PID 7133 died... 19:33:22.568730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7133): Terminated: ok {rc=0} 19:33:22.651352 bus /sierra_9: Setting Powered False 19:33:23.750307 bus /sierra_9: Setting Powered False 19:33:24.863884 bus /sierra_8: Setting Powered False 19:33:25.962330 bus /sierra_8: Setting Powered False 19:33:27.074943 bus /sierra_3: Setting Powered False 19:33:28.174651 bus /sierra_3: Setting Powered False 19:33:29.293490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 19:33:30.570436 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:30.575112 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:33:30.605424 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 19:33:30.644624 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 19:33:30.732788 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:33:30.762927 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 19:33:30.802087 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 19:33:31.445117 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 19:33:31.499232 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:31.511106 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:33:31.561337 tst cs_paging_gprs_active.py: using LAC 23235 19:33:31.715536 tst cs_paging_gprs_active.py: using RAC 30 19:33:31.862017 tst cs_paging_gprs_active.py: using CellId 23235 19:33:31.982821 tst cs_paging_gprs_active.py: using BVCI 23236 19:33:32.095840 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.107170 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.118952 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.131895 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.143252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.154810 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.166591 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.177897 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:32.189259 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:32.307072 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:32.423320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:33:32.630044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:32.937173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Launched 19:33:33.202401 run iperf3-srv_10.42.42.10(pid=7141): Launched 19:33:33.318557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:33:33.523063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:33.829501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7142): Launched 19:33:34.095496 run iperf3-srv_10.42.42.10(pid=7143): Launched 19:33:34.209122 tst cs_paging_gprs_active.py:38: start network... 19:33:34.413801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:34.885412 run create_hlr_db(pid=7144): Launched 19:33:35.009297 bus /sierra_2: Setting Powered False 19:33:36.070650 run create_hlr_db(pid=7144): Terminated: ok {rc=0} 19:33:36.516780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7146): Launched 19:33:36.844521 run osmo-hlr_10.42.42.2(pid=7147): Launched 19:33:36.970334 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:37.535522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7149): Launched 19:33:37.863901 run osmo-stp_10.42.42.5(pid=7150): Launched 19:33:37.989384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:38.553412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7152): Launched 19:33:38.678639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:38.956801 run patchelf(pid=7153): Launched 19:33:39.140277 run osmo-stp_10.42.42.5(pid=7150): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7150)] 19:33:39.279127 run osmo-stp_10.42.42.5(pid=7150): stdout: | (launched: 2022-12-09_19:33:37.804112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:39.419865 run osmo-stp_10.42.42.5(pid=7150): stderr: | [0;m[38;5;43m20221209193337994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193337995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193337995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193337995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:39.560061 run osmo-stp_10.42.42.5(pid=7150): stdout: | (launched: 2022-12-09_19:33:37.804112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:39.694271 run osmo-stp_10.42.42.5(pid=7150): stderr: | [0;m[38;5;43m20221209193337994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193337995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193337995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193337995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193337996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:39.853421 run patchelf(pid=7153): Terminating (SIGINT) 19:33:40.037183 run patchelf(pid=7153): Terminated: ok {rc=0} 19:33:40.169424 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7150): Process ended prematurely: osmo-stp_10.42.42.5(pid=7150) [trial-2363↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7150)] [trial-2363↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 19:33:40.179654 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:33:40.208675 run osmo-hlr_10.42.42.2(pid=7147): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7147)] 19:33:40.258368 run osmo-hlr_10.42.42.2(pid=7147): stdout: | (launched: 2022-12-09_19:33:36.784348) 19:33:40.309769 run osmo-hlr_10.42.42.2(pid=7147): stderr: | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193336982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193336995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193337003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193337003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193337003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:40.361373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminating (SIGTERM) 19:33:40.402735 run iperf3-srv_10.42.42.10(pid=7141): Terminating (SIGTERM) 19:33:40.444074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7142): Terminating (SIGTERM) 19:33:40.485543 run iperf3-srv_10.42.42.10(pid=7143): Terminating (SIGTERM) 19:33:40.527343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7146): Terminating (SIGTERM) 19:33:40.568842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7149): Terminating (SIGTERM) 19:33:40.610226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7152): Terminating (SIGTERM) 19:33:40.652123 --- ParallelTerminationStrategy: PID 7140 died... 19:33:40.671939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminated: ok {rc=0} 19:33:40.718454 --- ParallelTerminationStrategy: PID 7141 died... 19:33:40.737741 run iperf3-srv_10.42.42.10(pid=7141): Terminated {rc=256} 19:33:40.783863 --- ParallelTerminationStrategy: PID 7142 died... 19:33:40.803394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7142): Terminated: ok {rc=0} 19:33:40.849384 --- ParallelTerminationStrategy: PID 7143 died... 19:33:40.868636 run iperf3-srv_10.42.42.10(pid=7143): Terminated {rc=256} 19:33:40.914504 --- ParallelTerminationStrategy: PID 7146 died... 19:33:40.933877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7146): Terminated: ok {rc=0} 19:33:40.979661 --- ParallelTerminationStrategy: PID 7149 died... 19:33:40.999271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7149): Terminated: ok {rc=0} 19:33:41.045266 --- ParallelTerminationStrategy: PID 7152 died... 19:33:41.064730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7152): Terminated: ok {rc=0} 19:33:41.150926 bus /gobi_0: Setting Powered False 19:33:42.248575 bus /gobi_0: Setting Powered False 19:33:43.362256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 19:33:44.511616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:44.523561 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:33:44.573293 tst iperf3.py: using LAC 23236 19:33:44.700585 tst iperf3.py: using RAC 31 19:33:44.829361 tst iperf3.py: using CellId 23236 19:33:44.956584 tst iperf3.py: using BVCI 23237 19:33:45.071363 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.082367 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.092940 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.103902 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.114660 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.125515 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.136491 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.147204 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:45.158048 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:45.276517 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:33:45.499014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:45.833861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Launched 19:33:46.137708 run iperf3-srv_10.42.42.10(pid=7155): Launched 19:33:46.268819 tst iperf3.py:8: start network... 19:33:46.496508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:47.015553 run create_hlr_db(pid=7156): Launched 19:33:47.165118 bus /gobi_6: Setting Powered False 19:33:48.225863 run create_hlr_db(pid=7156): Terminated: ok {rc=0} 19:33:48.650892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Launched 19:33:48.955551 run osmo-hlr_10.42.42.2(pid=7159): Launched 19:33:49.071312 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:49.598714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Launched 19:33:49.905198 run osmo-stp_10.42.42.5(pid=7162): Launched 19:33:50.020919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:50.546915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Launched 19:33:50.663026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:50.920637 run patchelf(pid=7165): Launched 19:33:51.090415 run osmo-stp_10.42.42.5(pid=7162): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] 19:33:51.219126 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_19:33:49.848687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:51.349823 run osmo-stp_10.42.42.5(pid=7162): stderr: | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193350017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:51.480770 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_19:33:49.848687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:51.605426 run osmo-stp_10.42.42.5(pid=7162): stderr: | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193350016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193350017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193350017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:51.753601 run patchelf(pid=7165): Terminating (SIGINT) 19:33:51.924003 run patchelf(pid=7165): Terminated: ok {rc=0} 19:33:52.047306 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 19:33:52.056931 tst iperf3.py:8: Test FAILED (7.6 sec) 19:33:52.084034 run osmo-hlr_10.42.42.2(pid=7159): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7159)] 19:33:52.130694 run osmo-hlr_10.42.42.2(pid=7159): stdout: | (launched: 2022-12-09_19:33:48.899326) 19:33:52.178954 run osmo-hlr_10.42.42.2(pid=7159): stderr: | [0;m[1;31m20221209193349073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193349073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193349073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193349074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193349074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193349074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193349090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193349101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193349102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193349102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:52.227517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Terminating (SIGTERM) 19:33:52.266702 run iperf3-srv_10.42.42.10(pid=7155): Terminating (SIGTERM) 19:33:52.306026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminating (SIGTERM) 19:33:52.345232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminating (SIGTERM) 19:33:52.384302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Terminating (SIGTERM) 19:33:52.424227 --- ParallelTerminationStrategy: PID 7154 died... 19:33:52.443350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Terminated: ok {rc=0} 19:33:52.487604 --- ParallelTerminationStrategy: PID 7155 died... 19:33:52.506315 run iperf3-srv_10.42.42.10(pid=7155): Terminated {rc=256} 19:33:52.550489 --- ParallelTerminationStrategy: PID 7158 died... 19:33:52.569175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminated: ok {rc=0} 19:33:52.612941 --- ParallelTerminationStrategy: PID 7161 died... 19:33:52.631609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminated: ok {rc=0} 19:33:52.675280 --- ParallelTerminationStrategy: PID 7164 died... 19:33:52.694064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Terminated: ok {rc=0} 19:33:52.779211 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 19:33:53.926671 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:53.938290 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:33:53.988597 tst iperf3m4.py: using LAC 23237 19:33:54.108326 tst iperf3m4.py: using RAC 32 19:33:54.228318 tst iperf3m4.py: using CellId 23237 19:33:54.346036 tst iperf3m4.py: using BVCI 23238 19:33:54.456497 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.467521 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.478119 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.488698 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.499347 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.509978 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.520685 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.531252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:33:54.541985 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:54.661314 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:54.782378 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:54.901494 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:33:55.025848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:33:55.248743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:55.578205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7166): Launched 19:33:55.862842 run iperf3-srv_10.42.42.10(pid=7167): Launched 19:33:55.987406 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:33:56.209322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:56.539136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7168): Launched 19:33:56.824813 run iperf3-srv_10.42.42.10(pid=7169): Launched 19:33:56.948453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:33:57.169374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:57.498703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Launched 19:33:57.784125 run iperf3-srv_10.42.42.10(pid=7171): Launched 19:33:57.907871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:33:58.129264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:58.458999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Launched 19:33:58.745586 run iperf3-srv_10.42.42.10(pid=7173): Launched 19:33:58.869578 tst iperf3m4.py:8: start network... 19:33:59.091112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:59.598276 run create_hlr_db(pid=7174): Launched 19:33:59.723572 bus /gobi_6: Setting Powered False 19:34:00.787948 run create_hlr_db(pid=7174): Terminated: ok {rc=0} 19:34:01.282312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Launched 19:34:01.608798 run osmo-hlr_10.42.42.2(pid=7177): Launched 19:34:01.834700 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:02.554817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Launched 19:34:02.855297 run osmo-stp_10.42.42.5(pid=7180): Launched 19:34:02.967779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:03.485627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Launched 19:34:03.600039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:03.855004 run patchelf(pid=7183): Launched 19:34:04.022828 run osmo-stp_10.42.42.5(pid=7180): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] 19:34:04.150213 run osmo-stp_10.42.42.5(pid=7180): stdout: | (launched: 2022-12-09_19:34:02.800006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:04.278969 run osmo-stp_10.42.42.5(pid=7180): stderr: | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193402970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193402970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193402970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193402971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:04.407685 run osmo-stp_10.42.42.5(pid=7180): stdout: | (launched: 2022-12-09_19:34:02.800006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:04.530445 run osmo-stp_10.42.42.5(pid=7180): stderr: | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193402969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193402970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193402970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193402970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193402971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:04.675878 run patchelf(pid=7183): Terminating (SIGINT) 19:34:04.843735 run patchelf(pid=7183): Terminated: ok {rc=0} 19:34:04.964903 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7180): Process ended prematurely: osmo-stp_10.42.42.5(pid=7180) [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 19:34:04.974479 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:34:05.001610 run osmo-hlr_10.42.42.2(pid=7177): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7177)] 19:34:05.048047 run osmo-hlr_10.42.42.2(pid=7177): stdout: | (launched: 2022-12-09_19:34:01.550629) 19:34:05.096264 run osmo-hlr_10.42.42.2(pid=7177): stderr: | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193401835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193401869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193401893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193401894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193401894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:05.144769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7166): Terminating (SIGTERM) 19:34:05.183575 run iperf3-srv_10.42.42.10(pid=7167): Terminating (SIGTERM) 19:34:05.222201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7168): Terminating (SIGTERM) 19:34:05.260917 run iperf3-srv_10.42.42.10(pid=7169): Terminating (SIGTERM) 19:34:05.299388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Terminating (SIGTERM) 19:34:05.338011 run iperf3-srv_10.42.42.10(pid=7171): Terminating (SIGTERM) 19:34:05.376435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminating (SIGTERM) 19:34:05.415394 run iperf3-srv_10.42.42.10(pid=7173): Terminating (SIGTERM) 19:34:05.453926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Terminating (SIGTERM) 19:34:05.492439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Terminating (SIGTERM) 19:34:05.530931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Terminating (SIGTERM) 19:34:05.569791 --- ParallelTerminationStrategy: PID 7166 died... 19:34:05.588335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7166): Terminated: ok {rc=0} 19:34:05.631681 --- ParallelTerminationStrategy: PID 7167 died... 19:34:05.649855 run iperf3-srv_10.42.42.10(pid=7167): Terminated {rc=256} 19:34:05.692355 --- ParallelTerminationStrategy: PID 7168 died... 19:34:05.710643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7168): Terminated: ok {rc=0} 19:34:05.754264 --- ParallelTerminationStrategy: PID 7169 died... 19:34:05.772350 run iperf3-srv_10.42.42.10(pid=7169): Terminated {rc=256} 19:34:05.814987 --- ParallelTerminationStrategy: PID 7170 died... 19:34:05.833258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Terminated: ok {rc=0} 19:34:05.875825 --- ParallelTerminationStrategy: PID 7171 died... 19:34:05.893986 run iperf3-srv_10.42.42.10(pid=7171): Terminated {rc=256} 19:34:05.936545 --- ParallelTerminationStrategy: PID 7172 died... 19:34:05.954702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminated: ok {rc=0} 19:34:05.997308 --- ParallelTerminationStrategy: PID 7173 died... 19:34:06.015332 run iperf3-srv_10.42.42.10(pid=7173): Terminated {rc=256} 19:34:06.058182 --- ParallelTerminationStrategy: PID 7176 died... 19:34:06.076568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Terminated: ok {rc=0} 19:34:06.118986 --- ParallelTerminationStrategy: PID 7179 died... 19:34:06.136903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Terminated: ok {rc=0} 19:34:06.180048 --- ParallelTerminationStrategy: PID 7182 died... 19:34:06.198292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Terminated: ok {rc=0} 19:34:06.282416 bus /gobi_4: Setting Powered False 19:34:07.380250 bus /gobi_4: Setting Powered False 19:34:08.490037 bus /gobi_1: Setting Powered False 19:34:09.583808 bus /gobi_1: Setting Powered False 19:34:10.696352 bus /gobi_0: Setting Powered False 19:34:11.793937 bus /gobi_0: Setting Powered False 19:34:12.904125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 19:34:14.004554 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.016407 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:34:14.063161 tst ping.py: using LAC 23238 19:34:14.189235 tst ping.py: using RAC 33 19:34:14.317671 tst ping.py: using CellId 23238 19:34:14.441212 tst ping.py: using BVCI 23239 19:34:14.555876 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.567046 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.578095 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.589678 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.600766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.611930 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.623103 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:14.634361 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:14.751461 tst ping.py:19: start network... 19:34:14.964888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:15.456054 run create_hlr_db(pid=7185): Launched 19:34:15.577155 bus /gobi_6: Setting Powered False 19:34:16.637828 run create_hlr_db(pid=7185): Terminated: ok {rc=0} 19:34:17.088328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7187): Launched 19:34:17.410403 run osmo-hlr_10.42.42.2(pid=7188): Launched 19:34:17.534025 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:18.048846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7190): Launched 19:34:18.346543 run osmo-stp_10.42.42.5(pid=7191): Launched 19:34:18.461805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:18.978719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7193): Launched 19:34:19.092179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:19.343021 run patchelf(pid=7194): Launched 19:34:19.506722 run osmo-stp_10.42.42.5(pid=7191): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7191)] 19:34:19.631613 run osmo-stp_10.42.42.5(pid=7191): stdout: | (launched: 2022-12-09_19:34:18.291358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:19.757975 run osmo-stp_10.42.42.5(pid=7191): stderr: | [0;m[38;5;43m20221209193418462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193418462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193418463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193418463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193418463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193418463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193418464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:19.884305 run osmo-stp_10.42.42.5(pid=7191): stdout: | (launched: 2022-12-09_19:34:18.291358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:20.005299 run osmo-stp_10.42.42.5(pid=7191): stderr: | [0;m[38;5;43m20221209193418462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193418462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193418463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193418463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193418463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193418463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193418464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:20.148318 run patchelf(pid=7194): Terminating (SIGINT) 19:34:20.313826 run patchelf(pid=7194): Terminated: ok {rc=0} 19:34:20.432631 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7191): Process ended prematurely: osmo-stp_10.42.42.5(pid=7191) [trial-2363↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7191)] [trial-2363↪gprs:trx-lms-limenet-micro↪ping.py:22] 19:34:20.441692 tst ping.py:22: Test FAILED (6.4 sec) 19:34:20.467883 run osmo-hlr_10.42.42.2(pid=7188): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7188)] 19:34:20.514592 run osmo-hlr_10.42.42.2(pid=7188): stdout: | (launched: 2022-12-09_19:34:17.352208) 19:34:20.563204 run osmo-hlr_10.42.42.2(pid=7188): stderr: | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193417548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193417560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193417568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193417568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193417569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:20.612076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7187): Terminating (SIGTERM) 19:34:20.651051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7190): Terminating (SIGTERM) 19:34:20.690138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7193): Terminating (SIGTERM) 19:34:20.729214 --- ParallelTerminationStrategy: PID 7187 died... 19:34:20.747895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7187): Terminated: ok {rc=0} 19:34:20.791153 --- ParallelTerminationStrategy: PID 7190 died... 19:34:20.809258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7190): Terminated: ok {rc=0} 19:34:20.852400 --- ParallelTerminationStrategy: PID 7193 died... 19:34:20.870659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7193): Terminated: ok {rc=0} 19:34:20.954022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 19:34:22.040816 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.052083 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:34:22.098678 tst ping_idle_ping.py: using LAC 23239 19:34:22.217209 tst ping_idle_ping.py: using RAC 34 19:34:22.334402 tst ping_idle_ping.py: using CellId 23239 19:34:22.450858 tst ping_idle_ping.py: using BVCI 23240 19:34:22.559708 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.570492 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.580994 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.591921 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.602755 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.613636 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.624679 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:22.635640 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:22.748683 tst ping_idle_ping.py:24: start network... 19:34:22.948913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:23.411867 run create_hlr_db(pid=7195): Launched 19:34:23.532756 bus /gobi_6: Setting Powered False 19:34:24.593179 run create_hlr_db(pid=7195): Terminated: ok {rc=0} 19:34:25.009892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Launched 19:34:25.308038 run osmo-hlr_10.42.42.2(pid=7198): Launched 19:34:25.421066 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:25.935251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Launched 19:34:26.234912 run osmo-stp_10.42.42.5(pid=7201): Launched 19:34:26.348645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:26.863376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7203): Launched 19:34:26.976383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:27.228478 run patchelf(pid=7204): Launched 19:34:27.393563 run osmo-stp_10.42.42.5(pid=7201): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] 19:34:27.519540 run osmo-stp_10.42.42.5(pid=7201): stdout: | (launched: 2022-12-09_19:34:26.179253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:27.646820 run osmo-stp_10.42.42.5(pid=7201): stderr: | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193426349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:27.774547 run osmo-stp_10.42.42.5(pid=7201): stdout: | (launched: 2022-12-09_19:34:26.179253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:27.897271 run osmo-stp_10.42.42.5(pid=7201): stderr: | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193426348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193426349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193426349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:28.041852 run patchelf(pid=7204): Terminating (SIGINT) 19:34:28.207736 run patchelf(pid=7204): Terminated: ok {rc=0} 19:34:28.327556 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7201): Process ended prematurely: osmo-stp_10.42.42.5(pid=7201) [trial-2363↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] [trial-2363↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 19:34:28.337132 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:34:28.363403 run osmo-hlr_10.42.42.2(pid=7198): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7198)] 19:34:28.409980 run osmo-hlr_10.42.42.2(pid=7198): stdout: | (launched: 2022-12-09_19:34:25.252680) 19:34:28.458303 run osmo-hlr_10.42.42.2(pid=7198): stderr: | [0;m[1;31m20221209193425426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193425426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193425427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193425427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193425427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193425427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193425439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193425448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193425448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193425449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:28.506871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Terminating (SIGTERM) 19:34:28.545879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Terminating (SIGTERM) 19:34:28.584717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7203): Terminating (SIGTERM) 19:34:28.623712 --- ParallelTerminationStrategy: PID 7197 died... 19:34:28.642295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Terminated: ok {rc=0} 19:34:28.686205 --- ParallelTerminationStrategy: PID 7200 died... 19:34:28.704526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Terminated: ok {rc=0} 19:34:28.747240 --- ParallelTerminationStrategy: PID 7203 died... 19:34:28.765556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7203): Terminated: ok {rc=0} 19:34:28.849305 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 19:34:30.142635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:34:30.148171 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:34:30.177258 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:34:30.215001 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:34:30.299740 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:34:30.328082 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:34:30.366105 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:34:31.002974 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:34:31.061464 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.073992 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:34:31.123991 tst cs_paging_gprs_active.py: using LAC 23240 19:34:31.283310 tst cs_paging_gprs_active.py: using RAC 35 19:34:31.452380 tst cs_paging_gprs_active.py: using CellId 23240 19:34:31.582155 tst cs_paging_gprs_active.py: using BVCI 23241 19:34:31.694394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.706354 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.720720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.732399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.743979 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.755719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.767451 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.778645 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:31.790327 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:31.908416 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:32.031299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:34:32.283948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:32.612113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Launched 19:34:32.894903 run iperf3-srv_10.42.42.10(pid=7209): Launched 19:34:33.018150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:34:33.237180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:33.563381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Launched 19:34:33.845935 run iperf3-srv_10.42.42.10(pid=7211): Launched 19:34:33.968806 tst cs_paging_gprs_active.py:38: start network... 19:34:34.188014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:34.691177 run create_hlr_db(pid=7212): Launched 19:34:34.815000 bus /gobi_6: Setting Powered False 19:34:35.878685 run create_hlr_db(pid=7212): Terminated: ok {rc=0} 19:34:36.311896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7214): Launched 19:34:36.615914 run osmo-hlr_10.42.42.2(pid=7215): Launched 19:34:36.731128 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:37.258219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7217): Launched 19:34:37.561346 run osmo-stp_10.42.42.5(pid=7218): Launched 19:34:37.676431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:38.200753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7220): Launched 19:34:38.315933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:38.573352 run patchelf(pid=7221): Launched 19:34:38.741155 run osmo-stp_10.42.42.5(pid=7218): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7218)] 19:34:38.869223 run osmo-stp_10.42.42.5(pid=7218): stdout: | (launched: 2022-12-09_19:34:37.505186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:38.999068 run osmo-stp_10.42.42.5(pid=7218): stderr: | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193437675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:39.128595 run osmo-stp_10.42.42.5(pid=7218): stdout: | (launched: 2022-12-09_19:34:37.505186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:39.252508 run osmo-stp_10.42.42.5(pid=7218): stderr: | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193437675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193437675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:39.399342 run patchelf(pid=7221): Terminating (SIGINT) 19:34:39.568569 run patchelf(pid=7221): Terminated: ok {rc=0} 19:34:39.691341 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7218): Process ended prematurely: osmo-stp_10.42.42.5(pid=7218) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7218)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:34:39.701024 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:34:39.727740 run osmo-hlr_10.42.42.2(pid=7215): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7215)] 19:34:39.774925 run osmo-hlr_10.42.42.2(pid=7215): stdout: | (launched: 2022-12-09_19:34:36.559480) 19:34:39.823455 run osmo-hlr_10.42.42.2(pid=7215): stderr: | [0;m[1;31m20221209193436736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193436736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193436736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193436736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193436736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193436737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193436748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193436757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193436757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193436757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:39.872676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminating (SIGTERM) 19:34:39.911574 run iperf3-srv_10.42.42.10(pid=7209): Terminating (SIGTERM) 19:34:39.950296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Terminating (SIGTERM) 19:34:39.988894 run iperf3-srv_10.42.42.10(pid=7211): Terminating (SIGTERM) 19:34:40.027437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7214): Terminating (SIGTERM) 19:34:40.065978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7217): Terminating (SIGTERM) 19:34:40.104496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7220): Terminating (SIGTERM) 19:34:40.143388 --- ParallelTerminationStrategy: PID 7208 died... 19:34:40.161994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminated: ok {rc=0} 19:34:40.205565 --- ParallelTerminationStrategy: PID 7209 died... 19:34:40.223541 run iperf3-srv_10.42.42.10(pid=7209): Terminated {rc=256} 19:34:40.266275 --- ParallelTerminationStrategy: PID 7210 died... 19:34:40.284355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Terminated: ok {rc=0} 19:34:40.327130 --- ParallelTerminationStrategy: PID 7211 died... 19:34:40.345308 run iperf3-srv_10.42.42.10(pid=7211): Terminated {rc=256} 19:34:40.387897 --- ParallelTerminationStrategy: PID 7214 died... 19:34:40.406061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7214): Terminated: ok {rc=0} 19:34:40.449621 --- ParallelTerminationStrategy: PID 7217 died... 19:34:40.467928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7217): Terminated: ok {rc=0} 19:34:40.510782 --- ParallelTerminationStrategy: PID 7220 died... 19:34:40.528910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7220): Terminated: ok {rc=0} 19:34:40.613831 bus /gobi_0: Setting Powered False 19:34:41.711710 bus /gobi_0: Setting Powered False 19:34:42.826815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:34:43.971206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:43.982673 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:34:44.027975 tst iperf3.py: using LAC 23241 19:34:44.155251 tst iperf3.py: using RAC 36 19:34:44.282418 tst iperf3.py: using CellId 23241 19:34:44.409059 tst iperf3.py: using BVCI 23242 19:34:44.528052 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.539794 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.551267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.563251 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.574632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.586204 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.597822 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.609455 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:44.621132 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:44.735465 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:34:44.938078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:45.241221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Launched 19:34:45.503815 run iperf3-srv_10.42.42.10(pid=7223): Launched 19:34:45.616269 tst iperf3.py:8: start network... 19:34:45.818372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:46.307197 run create_hlr_db(pid=7224): Launched 19:34:46.467760 bus /gobi_6: Setting Powered False 19:34:47.527450 run create_hlr_db(pid=7224): Terminated: ok {rc=0} 19:34:47.968855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Launched 19:34:48.293423 run osmo-hlr_10.42.42.2(pid=7227): Launched 19:34:48.416879 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:48.973604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Launched 19:34:49.294739 run osmo-stp_10.42.42.5(pid=7230): Launched 19:34:49.418781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:49.974114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Launched 19:34:50.098154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:50.371966 run patchelf(pid=7233): Launched 19:34:50.550709 run osmo-stp_10.42.42.5(pid=7230): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] 19:34:50.687158 run osmo-stp_10.42.42.5(pid=7230): stdout: | (launched: 2022-12-09_19:34:49.235675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:50.825270 run osmo-stp_10.42.42.5(pid=7230): stderr: | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193449426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:50.963636 run osmo-stp_10.42.42.5(pid=7230): stdout: | (launched: 2022-12-09_19:34:49.235675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:51.095704 run osmo-stp_10.42.42.5(pid=7230): stderr: | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193449425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193449426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193449426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:51.252636 run patchelf(pid=7233): Terminating (SIGINT) 19:34:51.432911 run patchelf(pid=7233): Terminated: ok {rc=0} 19:34:51.562783 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7230): Process ended prematurely: osmo-stp_10.42.42.5(pid=7230) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 19:34:51.572899 tst iperf3.py:8: Test FAILED (7.6 sec) 19:34:51.601471 run osmo-hlr_10.42.42.2(pid=7227): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7227)] 19:34:51.651526 run osmo-hlr_10.42.42.2(pid=7227): stdout: | (launched: 2022-12-09_19:34:48.233702) 19:34:51.702944 run osmo-hlr_10.42.42.2(pid=7227): stderr: | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193448430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193448443 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193448451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193448451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193448452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:51.755070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Terminating (SIGTERM) 19:34:51.796756 run iperf3-srv_10.42.42.10(pid=7223): Terminating (SIGTERM) 19:34:51.838594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Terminating (SIGTERM) 19:34:51.880139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Terminating (SIGTERM) 19:34:51.922034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Terminating (SIGTERM) 19:34:51.963777 --- ParallelTerminationStrategy: PID 7222 died... 19:34:51.983579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Terminated: ok {rc=0} 19:34:52.030378 --- ParallelTerminationStrategy: PID 7223 died... 19:34:52.049658 run iperf3-srv_10.42.42.10(pid=7223): Terminated {rc=256} 19:34:52.095601 --- ParallelTerminationStrategy: PID 7226 died... 19:34:52.115032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Terminated: ok {rc=0} 19:34:52.160821 --- ParallelTerminationStrategy: PID 7229 died... 19:34:52.180430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Terminated: ok {rc=0} 19:34:52.226533 --- ParallelTerminationStrategy: PID 7232 died... 19:34:52.245944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Terminated: ok {rc=0} 19:34:52.333139 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:34:53.483045 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:53.495287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:34:53.542303 tst iperf3m4.py: using LAC 23242 19:34:53.683129 tst iperf3m4.py: using RAC 37 19:34:53.813366 tst iperf3m4.py: using CellId 23242 19:34:53.938846 tst iperf3m4.py: using BVCI 23243 19:34:54.057209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.068785 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.080198 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.091859 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.103332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.115149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.126803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.138326 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:34:54.150094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:54.279683 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:54.397856 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:54.514976 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:34:54.634999 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:34:54.852726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:55.176778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7234): Launched 19:34:55.459859 run iperf3-srv_10.42.42.10(pid=7235): Launched 19:34:55.580610 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:34:55.798413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:56.123003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7236): Launched 19:34:56.406115 run iperf3-srv_10.42.42.10(pid=7237): Launched 19:34:56.528285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:34:56.746514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:57.071469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7238): Launched 19:34:57.354874 run iperf3-srv_10.42.42.10(pid=7239): Launched 19:34:57.475803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:34:57.694112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:58.019569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Launched 19:34:58.301554 run iperf3-srv_10.42.42.10(pid=7241): Launched 19:34:58.424445 tst iperf3m4.py:8: start network... 19:34:58.642768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:59.145332 run create_hlr_db(pid=7242): Launched 19:34:59.267320 bus /gobi_6: Setting Powered False 19:35:00.330973 run create_hlr_db(pid=7242): Terminated: ok {rc=0} 19:35:00.781501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7244): Launched 19:35:01.122118 run osmo-hlr_10.42.42.2(pid=7245): Launched 19:35:01.417574 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:02.030981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7250): Launched 19:35:02.366661 run osmo-stp_10.42.42.5(pid=7251): Launched 19:35:02.490329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:03.048487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7253): Launched 19:35:03.173209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:03.447923 run patchelf(pid=7254): Launched 19:35:03.628091 run osmo-stp_10.42.42.5(pid=7251): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7251)] 19:35:03.764735 run osmo-stp_10.42.42.5(pid=7251): stdout: | (launched: 2022-12-09_19:35:02.306310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:03.903185 run osmo-stp_10.42.42.5(pid=7251): stderr: | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193502493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:04.041799 run osmo-stp_10.42.42.5(pid=7251): stdout: | (launched: 2022-12-09_19:35:02.306310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:04.174247 run osmo-stp_10.42.42.5(pid=7251): stderr: | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193502493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193502493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193502494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:04.331813 run patchelf(pid=7254): Terminating (SIGINT) 19:35:04.513657 run patchelf(pid=7254): Terminated: ok {rc=0} 19:35:04.644177 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7251): Process ended prematurely: osmo-stp_10.42.42.5(pid=7251) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7251)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 19:35:04.654658 tst iperf3m4.py:8: Test FAILED (11.2 sec) 19:35:04.683776 run osmo-hlr_10.42.42.2(pid=7245): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7245)] 19:35:04.733216 run osmo-hlr_10.42.42.2(pid=7245): stdout: | (launched: 2022-12-09_19:35:01.063719) 19:35:04.784486 run osmo-hlr_10.42.42.2(pid=7245): stderr: | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193501276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193501289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193501316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193501317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193501317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:04.836173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7234): Terminating (SIGTERM) 19:35:04.877576 run iperf3-srv_10.42.42.10(pid=7235): Terminating (SIGTERM) 19:35:04.918967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7236): Terminating (SIGTERM) 19:35:04.960663 run iperf3-srv_10.42.42.10(pid=7237): Terminating (SIGTERM) 19:35:05.002195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7238): Terminating (SIGTERM) 19:35:05.043644 run iperf3-srv_10.42.42.10(pid=7239): Terminating (SIGTERM) 19:35:05.085011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Terminating (SIGTERM) 19:35:05.126599 run iperf3-srv_10.42.42.10(pid=7241): Terminating (SIGTERM) 19:35:05.168067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7244): Terminating (SIGTERM) 19:35:05.209568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7250): Terminating (SIGTERM) 19:35:05.251059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7253): Terminating (SIGTERM) 19:35:05.292431 --- ParallelTerminationStrategy: PID 7234 died... 19:35:05.312185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7234): Terminated: ok {rc=0} 19:35:05.358957 --- ParallelTerminationStrategy: PID 7235 died... 19:35:05.378279 run iperf3-srv_10.42.42.10(pid=7235): Terminated {rc=256} 19:35:05.424405 --- ParallelTerminationStrategy: PID 7236 died... 19:35:05.443823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7236): Terminated: ok {rc=0} 19:35:05.489696 --- ParallelTerminationStrategy: PID 7237 died... 19:35:05.508799 run iperf3-srv_10.42.42.10(pid=7237): Terminated {rc=256} 19:35:05.554528 --- ParallelTerminationStrategy: PID 7238 died... 19:35:05.574031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7238): Terminated: ok {rc=0} 19:35:05.620179 --- ParallelTerminationStrategy: PID 7239 died... 19:35:05.639540 run iperf3-srv_10.42.42.10(pid=7239): Terminated {rc=256} 19:35:05.685445 --- ParallelTerminationStrategy: PID 7240 died... 19:35:05.704873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Terminated: ok {rc=0} 19:35:05.750703 --- ParallelTerminationStrategy: PID 7241 died... 19:35:05.770071 run iperf3-srv_10.42.42.10(pid=7241): Terminated {rc=256} 19:35:05.815766 --- ParallelTerminationStrategy: PID 7244 died... 19:35:05.835200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7244): Terminated: ok {rc=0} 19:35:05.881137 --- ParallelTerminationStrategy: PID 7250 died... 19:35:05.900300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7250): Terminated: ok {rc=0} 19:35:05.946559 --- ParallelTerminationStrategy: PID 7253 died... 19:35:05.966070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7253): Terminated: ok {rc=0} 19:35:06.053499 bus /gobi_4: Setting Powered False 19:35:07.151335 bus /gobi_4: Setting Powered False 19:35:08.265564 bus /gobi_1: Setting Powered False 19:35:09.362752 bus /gobi_1: Setting Powered False 19:35:10.478373 bus /gobi_0: Setting Powered False 19:35:11.575505 bus /gobi_0: Setting Powered False 19:35:12.690465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 19:35:13.793067 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:13.804516 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:35:13.851908 tst ping.py: using LAC 23243 19:35:13.969363 tst ping.py: using RAC 38 19:35:14.093490 tst ping.py: using CellId 23243 19:35:14.208630 tst ping.py: using BVCI 23244 19:35:14.315969 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.326949 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.337687 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.348490 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.359317 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.370000 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.380773 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:14.391456 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:35:14.508119 tst ping.py:19: start network... 19:35:14.722124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:15.213188 run create_hlr_db(pid=7255): Launched 19:35:15.335514 bus /gobi_6: Setting Powered False 19:35:16.400633 run create_hlr_db(pid=7255): Terminated: ok {rc=0} 19:35:16.848030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7257): Launched 19:35:17.178825 run osmo-hlr_10.42.42.2(pid=7258): Launched 19:35:17.300642 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:17.849960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7260): Launched 19:35:18.168554 run osmo-stp_10.42.42.5(pid=7261): Launched 19:35:18.288489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:18.836584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7263): Launched 19:35:18.957839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:19.227511 run patchelf(pid=7264): Launched 19:35:19.406182 run osmo-stp_10.42.42.5(pid=7261): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7261)] 19:35:19.540920 run osmo-stp_10.42.42.5(pid=7261): stdout: | (launched: 2022-12-09_19:35:18.110040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:19.677357 run osmo-stp_10.42.42.5(pid=7261): stderr: | [0;m[38;5;43m20221209193518300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193518300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193518301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193518301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:19.814232 run osmo-stp_10.42.42.5(pid=7261): stdout: | (launched: 2022-12-09_19:35:18.110040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:19.945490 run osmo-stp_10.42.42.5(pid=7261): stderr: | [0;m[38;5;43m20221209193518300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193518300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193518301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193518301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193518302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:20.100276 run patchelf(pid=7264): Terminating (SIGINT) 19:35:20.277309 run patchelf(pid=7264): Terminated: ok {rc=0} 19:35:20.405853 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7261): Process ended prematurely: osmo-stp_10.42.42.5(pid=7261) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7261)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 19:35:20.415644 tst ping.py:22: Test FAILED (6.6 sec) 19:35:20.444355 run osmo-hlr_10.42.42.2(pid=7258): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7258)] 19:35:20.494263 run osmo-hlr_10.42.42.2(pid=7258): stdout: | (launched: 2022-12-09_19:35:17.119890) 19:35:20.545968 run osmo-hlr_10.42.42.2(pid=7258): stderr: | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193517315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193517327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193517335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193517336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193517336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:20.598016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7257): Terminating (SIGTERM) 19:35:20.639664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7260): Terminating (SIGTERM) 19:35:20.681439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7263): Terminating (SIGTERM) 19:35:20.723413 --- ParallelTerminationStrategy: PID 7257 died... 19:35:20.743401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7257): Terminated: ok {rc=0} 19:35:20.791005 --- ParallelTerminationStrategy: PID 7260 died... 19:35:20.810582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7260): Terminated: ok {rc=0} 19:35:20.856852 --- ParallelTerminationStrategy: PID 7263 died... 19:35:20.876716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7263): Terminated: ok {rc=0} 19:35:20.963581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:35:22.050957 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.063677 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:35:22.113417 tst ping_idle_ping.py: using LAC 23244 19:35:22.239370 tst ping_idle_ping.py: using RAC 39 19:35:22.364126 tst ping_idle_ping.py: using CellId 23244 19:35:22.490663 tst ping_idle_ping.py: using BVCI 23245 19:35:22.599268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.610287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.620997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.632112 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.642809 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.653427 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.664269 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:22.674997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:35:22.792517 tst ping_idle_ping.py:24: start network... 19:35:23.007965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:23.504913 run create_hlr_db(pid=7265): Launched 19:35:23.627504 bus /gobi_6: Setting Powered False 19:35:24.690481 run create_hlr_db(pid=7265): Terminated: ok {rc=0} 19:35:25.135244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Launched 19:35:25.455964 run osmo-hlr_10.42.42.2(pid=7268): Launched 19:35:25.578990 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:26.129635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Launched 19:35:26.450098 run osmo-stp_10.42.42.5(pid=7271): Launched 19:35:26.571085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:27.122406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Launched 19:35:27.243925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:27.514367 run patchelf(pid=7274): Launched 19:35:27.692571 run osmo-stp_10.42.42.5(pid=7271): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] 19:35:27.827815 run osmo-stp_10.42.42.5(pid=7271): stdout: | (launched: 2022-12-09_19:35:26.390601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:27.964717 run osmo-stp_10.42.42.5(pid=7271): stderr: | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193526581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:28.102024 run osmo-stp_10.42.42.5(pid=7271): stdout: | (launched: 2022-12-09_19:35:26.390601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:28.233187 run osmo-stp_10.42.42.5(pid=7271): stderr: | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193526581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193526581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193526582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:28.388940 run patchelf(pid=7274): Terminating (SIGINT) 19:35:28.567212 run patchelf(pid=7274): Terminated: ok {rc=0} 19:35:28.695271 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7271): Process ended prematurely: osmo-stp_10.42.42.5(pid=7271) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 19:35:28.705039 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:35:28.733120 run osmo-hlr_10.42.42.2(pid=7268): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7268)] 19:35:28.783079 run osmo-hlr_10.42.42.2(pid=7268): stdout: | (launched: 2022-12-09_19:35:25.397025) 19:35:28.834993 run osmo-hlr_10.42.42.2(pid=7268): stderr: | [0;m[1;31m20221209193525593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193525593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193525593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193525593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193525594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193525594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193525606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193525614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193525614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193525615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:28.886872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Terminating (SIGTERM) 19:35:28.928441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Terminating (SIGTERM) 19:35:28.970068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Terminating (SIGTERM) 19:35:29.011806 --- ParallelTerminationStrategy: PID 7267 died... 19:35:29.031583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7267): Terminated: ok {rc=0} 19:35:29.078162 --- ParallelTerminationStrategy: PID 7270 died... 19:35:29.097656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7270): Terminated: ok {rc=0} 19:35:29.143551 --- ParallelTerminationStrategy: PID 7273 died... 19:35:29.162928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7273): Terminated: ok {rc=0} 19:35:29.250141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:35:30.558477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:35:30.565284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:35:30.596551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:35:30.635876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:35:30.722425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:35:30.752048 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:35:30.792124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:35:31.396748 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:35:31.452919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:31.465458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:35:31.537142 tst cs_paging_gprs_active.py: using LAC 23245 19:35:31.666573 tst cs_paging_gprs_active.py: using RAC 40 19:35:31.823991 tst cs_paging_gprs_active.py: using CellId 23245 19:35:32.020117 tst cs_paging_gprs_active.py: using BVCI 23246 19:35:32.134824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.146845 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.158735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.170730 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.182184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.193603 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.205236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.216581 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:32.228140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:32.348890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:32.468101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:35:32.688575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:33.015626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Launched 19:35:33.298065 run iperf3-srv_10.42.42.10(pid=7280): Launched 19:35:33.421470 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:35:33.640576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:33.966486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7281): Launched 19:35:34.249780 run iperf3-srv_10.42.42.10(pid=7282): Launched 19:35:34.373154 tst cs_paging_gprs_active.py:38: start network... 19:35:34.592243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:35.096361 run create_hlr_db(pid=7283): Launched 19:35:35.221810 bus /gobi_6: Setting Powered False 19:35:36.286396 run create_hlr_db(pid=7283): Terminated: ok {rc=0} 19:35:36.739209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Launched 19:35:37.064245 run osmo-hlr_10.42.42.2(pid=7286): Launched 19:35:37.188116 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:37.749351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Launched 19:35:38.075327 run osmo-stp_10.42.42.5(pid=7289): Launched 19:35:38.200527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:38.759875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7291): Launched 19:35:38.885205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:39.160351 run patchelf(pid=7292): Launched 19:35:39.341646 run osmo-stp_10.42.42.5(pid=7289): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] 19:35:39.479302 run osmo-stp_10.42.42.5(pid=7289): stdout: | (launched: 2022-12-09_19:35:38.015576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:39.618315 run osmo-stp_10.42.42.5(pid=7289): stderr: | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193538204 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:39.756706 run osmo-stp_10.42.42.5(pid=7289): stdout: | (launched: 2022-12-09_19:35:38.015576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:39.889570 run osmo-stp_10.42.42.5(pid=7289): stderr: | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193538203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193538204 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193538204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:40.047020 run patchelf(pid=7292): Terminating (SIGINT) 19:35:40.228128 run patchelf(pid=7292): Terminated: ok {rc=0} 19:35:40.359678 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7289): Process ended prematurely: osmo-stp_10.42.42.5(pid=7289) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:35:40.370303 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 19:35:40.399185 run osmo-hlr_10.42.42.2(pid=7286): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7286)] 19:35:40.449157 run osmo-hlr_10.42.42.2(pid=7286): stdout: | (launched: 2022-12-09_19:35:37.004286) 19:35:40.500233 run osmo-hlr_10.42.42.2(pid=7286): stderr: | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193537201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193537214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193537222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193537222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193537222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:40.551736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Terminating (SIGTERM) 19:35:40.593143 run iperf3-srv_10.42.42.10(pid=7280): Terminating (SIGTERM) 19:35:40.634540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7281): Terminating (SIGTERM) 19:35:40.675736 run iperf3-srv_10.42.42.10(pid=7282): Terminating (SIGTERM) 19:35:40.717057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Terminating (SIGTERM) 19:35:40.758834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Terminating (SIGTERM) 19:35:40.800052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7291): Terminating (SIGTERM) 19:35:40.841538 --- ParallelTerminationStrategy: PID 7279 died... 19:35:40.861262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Terminated: ok {rc=0} 19:35:40.907359 --- ParallelTerminationStrategy: PID 7280 died... 19:35:40.926706 run iperf3-srv_10.42.42.10(pid=7280): Terminated {rc=256} 19:35:40.972578 --- ParallelTerminationStrategy: PID 7281 died... 19:35:40.991802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7281): Terminated: ok {rc=0} 19:35:41.038024 --- ParallelTerminationStrategy: PID 7282 died... 19:35:41.057338 run iperf3-srv_10.42.42.10(pid=7282): Terminated {rc=256} 19:35:41.103399 --- ParallelTerminationStrategy: PID 7285 died... 19:35:41.122781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Terminated: ok {rc=0} 19:35:41.168456 --- ParallelTerminationStrategy: PID 7288 died... 19:35:41.187733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Terminated: ok {rc=0} 19:35:41.233511 --- ParallelTerminationStrategy: PID 7291 died... 19:35:41.252824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7291): Terminated: ok {rc=0} 19:35:41.338914 bus /gobi_0: Setting Powered False 19:35:42.439331 bus /gobi_0: Setting Powered False 19:35:43.554289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:35:44.699270 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:44.711064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:35:44.778630 tst iperf3.py: using LAC 23246 19:35:44.897783 tst iperf3.py: using RAC 41 19:35:45.016686 tst iperf3.py: using CellId 23246 19:35:45.135684 tst iperf3.py: using BVCI 23247 19:35:45.247257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.258237 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.268919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.279671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.290280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.300885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.311743 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.322553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:45.333377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:45.448669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:45.655571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:45.969779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7294): Launched 19:35:46.279841 run iperf3-srv_10.42.42.10(pid=7295): Launched 19:35:46.439393 tst iperf3.py:8: start network... 19:35:46.677449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:47.156119 run create_hlr_db(pid=7296): Launched 19:35:47.311800 bus /gobi_6: Setting Powered False 19:35:48.371816 run create_hlr_db(pid=7296): Terminated: ok {rc=0} 19:35:48.794734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7298): Launched 19:35:49.098736 run osmo-hlr_10.42.42.2(pid=7299): Launched 19:35:49.212478 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:49.750836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7301): Launched 19:35:50.053885 run osmo-stp_10.42.42.5(pid=7302): Launched 19:35:50.168020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:50.691333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7304): Launched 19:35:50.806948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:51.064346 run patchelf(pid=7305): Launched 19:35:51.232308 run osmo-stp_10.42.42.5(pid=7302): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7302)] 19:35:51.360556 run osmo-stp_10.42.42.5(pid=7302): stdout: | (launched: 2022-12-09_19:35:49.997827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:51.490720 run osmo-stp_10.42.42.5(pid=7302): stderr: | [0;m[38;5;43m20221209193550167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193550167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193550168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193550168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:51.620725 run osmo-stp_10.42.42.5(pid=7302): stdout: | (launched: 2022-12-09_19:35:49.997827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:51.745157 run osmo-stp_10.42.42.5(pid=7302): stderr: | [0;m[38;5;43m20221209193550167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193550167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193550168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193550168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193550169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:51.893188 run patchelf(pid=7305): Terminating (SIGINT) 19:35:52.063061 run patchelf(pid=7305): Terminated: ok {rc=0} 19:35:52.185393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7302): Process ended prematurely: osmo-stp_10.42.42.5(pid=7302) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7302)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 19:35:52.194890 tst iperf3.py:8: Test FAILED (7.5 sec) 19:35:52.221757 run osmo-hlr_10.42.42.2(pid=7299): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7299)] 19:35:52.268373 run osmo-hlr_10.42.42.2(pid=7299): stdout: | (launched: 2022-12-09_19:35:49.042210) 19:35:52.316672 run osmo-hlr_10.42.42.2(pid=7299): stderr: | [0;m[1;31m20221209193549218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193549218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193549218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193549219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193549219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193549219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193549230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193549240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193549241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193549241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:52.365501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7294): Terminating (SIGTERM) 19:35:52.404641 run iperf3-srv_10.42.42.10(pid=7295): Terminating (SIGTERM) 19:35:52.443660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7298): Terminating (SIGTERM) 19:35:52.482722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7301): Terminating (SIGTERM) 19:35:52.521782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7304): Terminating (SIGTERM) 19:35:52.560762 --- ParallelTerminationStrategy: PID 7294 died... 19:35:52.579671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7294): Terminated: ok {rc=0} 19:35:52.622933 --- ParallelTerminationStrategy: PID 7295 died... 19:35:52.641616 run iperf3-srv_10.42.42.10(pid=7295): Terminated {rc=256} 19:35:52.684518 --- ParallelTerminationStrategy: PID 7298 died... 19:35:52.702966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7298): Terminated: ok {rc=0} 19:35:52.746361 --- ParallelTerminationStrategy: PID 7301 died... 19:35:52.764459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7301): Terminated: ok {rc=0} 19:35:52.807155 --- ParallelTerminationStrategy: PID 7304 died... 19:35:52.825377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7304): Terminated: ok {rc=0} 19:35:52.910388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:35:54.056105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.067798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:35:54.134047 tst iperf3m4.py: using LAC 23247 19:35:54.263225 tst iperf3m4.py: using RAC 42 19:35:54.390737 tst iperf3m4.py: using CellId 23247 19:35:54.518261 tst iperf3m4.py: using BVCI 23248 19:35:54.638608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.650361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.661612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.673456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.684802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.696262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.707850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.719232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:35:54.730901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:54.851123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:54.974867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:55.095736 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:35:55.215591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:55.436034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:55.762363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Launched 19:35:56.047811 run iperf3-srv_10.42.42.10(pid=7307): Launched 19:35:56.170654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:35:56.390846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:56.718027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Launched 19:35:56.999818 run iperf3-srv_10.42.42.10(pid=7309): Launched 19:35:57.121401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:35:57.339848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:57.666764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Launched 19:35:57.949340 run iperf3-srv_10.42.42.10(pid=7311): Launched 19:35:58.070497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:35:58.290581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:58.617838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Launched 19:35:58.899420 run iperf3-srv_10.42.42.10(pid=7313): Launched 19:35:59.020740 tst iperf3m4.py:8: start network... 19:35:59.240219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:59.743833 run create_hlr_db(pid=7314): Launched 19:35:59.867278 bus /gobi_6: Setting Powered False 19:36:00.944817 run create_hlr_db(pid=7314): Terminated: ok {rc=0} 19:36:01.407614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7316): Launched 19:36:01.765638 run osmo-hlr_10.42.42.2(pid=7317): Launched 19:36:02.038682 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:02.688794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7319): Launched 19:36:03.014598 run osmo-stp_10.42.42.5(pid=7320): Launched 19:36:03.138911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:03.697931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7322): Launched 19:36:03.822168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:04.097391 run patchelf(pid=7323): Launched 19:36:04.278482 run osmo-stp_10.42.42.5(pid=7320): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7320)] 19:36:04.415741 run osmo-stp_10.42.42.5(pid=7320): stdout: | (launched: 2022-12-09_19:36:02.954663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:04.554092 run osmo-stp_10.42.42.5(pid=7320): stderr: | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193603144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193603144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193603145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193603145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:04.692279 run osmo-stp_10.42.42.5(pid=7320): stdout: | (launched: 2022-12-09_19:36:02.954663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:04.824698 run osmo-stp_10.42.42.5(pid=7320): stderr: | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193603143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193603144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193603144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193603145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193603145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:04.981972 run patchelf(pid=7323): Terminating (SIGINT) 19:36:05.162637 run patchelf(pid=7323): Terminated: ok {rc=0} 19:36:05.292861 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7320): Process ended prematurely: osmo-stp_10.42.42.5(pid=7320) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7320)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:36:05.303218 tst iperf3m4.py:8: Test FAILED (11.3 sec) 19:36:05.331988 run osmo-hlr_10.42.42.2(pid=7317): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7317)] 19:36:05.382114 run osmo-hlr_10.42.42.2(pid=7317): stdout: | (launched: 2022-12-09_19:36:01.700071) 19:36:05.433396 run osmo-hlr_10.42.42.2(pid=7317): stderr: | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193601972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193601987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193602002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193602002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193602003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:05.484743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Terminating (SIGTERM) 19:36:05.526057 run iperf3-srv_10.42.42.10(pid=7307): Terminating (SIGTERM) 19:36:05.567577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminating (SIGTERM) 19:36:05.608765 run iperf3-srv_10.42.42.10(pid=7309): Terminating (SIGTERM) 19:36:05.649858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminating (SIGTERM) 19:36:05.691189 run iperf3-srv_10.42.42.10(pid=7311): Terminating (SIGTERM) 19:36:05.732217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Terminating (SIGTERM) 19:36:05.773449 run iperf3-srv_10.42.42.10(pid=7313): Terminating (SIGTERM) 19:36:05.814389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7316): Terminating (SIGTERM) 19:36:05.855681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7319): Terminating (SIGTERM) 19:36:05.896829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7322): Terminating (SIGTERM) 19:36:05.938208 --- ParallelTerminationStrategy: PID 7306 died... 19:36:05.957810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Terminated: ok {rc=0} 19:36:06.003518 --- ParallelTerminationStrategy: PID 7307 died... 19:36:06.022775 run iperf3-srv_10.42.42.10(pid=7307): Terminated {rc=256} 19:36:06.068383 --- ParallelTerminationStrategy: PID 7308 died... 19:36:06.087711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminated: ok {rc=0} 19:36:06.133911 --- ParallelTerminationStrategy: PID 7309 died... 19:36:06.153107 run iperf3-srv_10.42.42.10(pid=7309): Terminated {rc=256} 19:36:06.198831 --- ParallelTerminationStrategy: PID 7310 died... 19:36:06.218020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminated: ok {rc=0} 19:36:06.264111 --- ParallelTerminationStrategy: PID 7311 died... 19:36:06.283488 run iperf3-srv_10.42.42.10(pid=7311): Terminated {rc=256} 19:36:06.329726 --- ParallelTerminationStrategy: PID 7312 died... 19:36:06.349216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Terminated: ok {rc=0} 19:36:06.395712 --- ParallelTerminationStrategy: PID 7313 died... 19:36:06.415212 run iperf3-srv_10.42.42.10(pid=7313): Terminated {rc=256} 19:36:06.461155 --- ParallelTerminationStrategy: PID 7316 died... 19:36:06.481144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7316): Terminated: ok {rc=0} 19:36:06.527139 --- ParallelTerminationStrategy: PID 7319 died... 19:36:06.546641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7319): Terminated: ok {rc=0} 19:36:06.592842 --- ParallelTerminationStrategy: PID 7322 died... 19:36:06.612574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7322): Terminated: ok {rc=0} 19:36:06.700452 bus /gobi_4: Setting Powered False 19:36:07.798763 bus /gobi_4: Setting Powered False 19:36:08.913610 bus /gobi_1: Setting Powered False 19:36:10.010779 bus /gobi_1: Setting Powered False 19:36:11.127760 bus /gobi_0: Setting Powered False 19:36:12.225168 bus /gobi_0: Setting Powered False 19:36:13.339569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:36:14.441616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:14.453288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:36:14.517423 tst ping.py: using LAC 23248 19:36:14.634144 tst ping.py: using RAC 43 19:36:14.754124 tst ping.py: using CellId 23248 19:36:14.870445 tst ping.py: using BVCI 23249 19:36:14.979593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:14.990710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.001592 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.012237 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.022907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.033724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.044480 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:15.055597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:36:15.168416 tst ping.py:19: start network... 19:36:15.368883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:15.833274 run create_hlr_db(pid=7324): Launched 19:36:15.991881 bus /gobi_6: Setting Powered False 19:36:17.051365 run create_hlr_db(pid=7324): Terminated: ok {rc=0} 19:36:17.486557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Launched 19:36:17.785574 run osmo-hlr_10.42.42.2(pid=7327): Launched 19:36:17.899582 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:18.415501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Launched 19:36:18.712765 run osmo-stp_10.42.42.5(pid=7330): Launched 19:36:18.825127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:19.339654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Launched 19:36:19.453100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:19.705597 run patchelf(pid=7333): Launched 19:36:19.870246 run osmo-stp_10.42.42.5(pid=7330): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] 19:36:19.996331 run osmo-stp_10.42.42.5(pid=7330): stdout: | (launched: 2022-12-09_19:36:18.657590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:20.124014 run osmo-stp_10.42.42.5(pid=7330): stderr: | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193618829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:20.251577 run osmo-stp_10.42.42.5(pid=7330): stdout: | (launched: 2022-12-09_19:36:18.657590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:20.373665 run osmo-stp_10.42.42.5(pid=7330): stderr: | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193618829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193618829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:20.518514 run patchelf(pid=7333): Terminating (SIGINT) 19:36:20.685139 run patchelf(pid=7333): Terminated: ok {rc=0} 19:36:20.805187 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7330): Process ended prematurely: osmo-stp_10.42.42.5(pid=7330) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 19:36:20.813999 tst ping.py:22: Test FAILED (6.4 sec) 19:36:20.840334 run osmo-hlr_10.42.42.2(pid=7327): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7327)] 19:36:20.887261 run osmo-hlr_10.42.42.2(pid=7327): stdout: | (launched: 2022-12-09_19:36:17.730007) 19:36:20.935822 run osmo-hlr_10.42.42.2(pid=7327): stderr: | [0;m[1;31m20221209193617906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193617906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193617906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193617907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193617907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193617907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193617918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193617927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193617927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193617927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:20.984592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Terminating (SIGTERM) 19:36:21.023903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Terminating (SIGTERM) 19:36:21.063329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Terminating (SIGTERM) 19:36:21.103093 --- ParallelTerminationStrategy: PID 7326 died... 19:36:21.122134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Terminated: ok {rc=0} 19:36:21.165910 --- ParallelTerminationStrategy: PID 7329 died... 19:36:21.184214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Terminated: ok {rc=0} 19:36:21.228088 --- ParallelTerminationStrategy: PID 7332 died... 19:36:21.246927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Terminated: ok {rc=0} 19:36:21.332851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:36:22.419959 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:22.431573 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:36:22.497745 tst ping_idle_ping.py: using LAC 23249 19:36:22.618476 tst ping_idle_ping.py: using RAC 44 19:36:22.735587 tst ping_idle_ping.py: using CellId 23249 19:36:22.851165 tst ping_idle_ping.py: using BVCI 23250 19:36:22.959217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:22.970286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:22.981133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:22.991960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:23.002671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:23.013503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:23.024353 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:23.035141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:36:23.152635 tst ping_idle_ping.py:24: start network... 19:36:23.370743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:23.870827 run create_hlr_db(pid=7334): Launched 19:36:23.994624 bus /gobi_6: Setting Powered False 19:36:25.059328 run create_hlr_db(pid=7334): Terminated: ok {rc=0} 19:36:25.489671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7336): Launched 19:36:25.790666 run osmo-hlr_10.42.42.2(pid=7337): Launched 19:36:25.904673 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:26.420200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7339): Launched 19:36:26.720303 run osmo-stp_10.42.42.5(pid=7340): Launched 19:36:26.833943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:27.351661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7342): Launched 19:36:27.465119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:27.718001 run patchelf(pid=7343): Launched 19:36:27.883586 run osmo-stp_10.42.42.5(pid=7340): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7340)] 19:36:28.009977 run osmo-stp_10.42.42.5(pid=7340): stdout: | (launched: 2022-12-09_19:36:26.664209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:28.137843 run osmo-stp_10.42.42.5(pid=7340): stderr: | [0;m[38;5;43m20221209193626834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193626834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193626835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193626835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193626835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193626835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193626836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:28.265541 run osmo-stp_10.42.42.5(pid=7340): stdout: | (launched: 2022-12-09_19:36:26.664209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:28.388016 run osmo-stp_10.42.42.5(pid=7340): stderr: | [0;m[38;5;43m20221209193626834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193626834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193626835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193626835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193626835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193626835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193626836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:28.533192 run patchelf(pid=7343): Terminating (SIGINT) 19:36:28.700346 run patchelf(pid=7343): Terminated: ok {rc=0} 19:36:28.820720 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7340): Process ended prematurely: osmo-stp_10.42.42.5(pid=7340) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7340)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:36:28.829738 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:36:28.855909 run osmo-hlr_10.42.42.2(pid=7337): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7337)] 19:36:28.902729 run osmo-hlr_10.42.42.2(pid=7337): stdout: | (launched: 2022-12-09_19:36:25.734444) 19:36:28.950529 run osmo-hlr_10.42.42.2(pid=7337): stderr: | [0;m[1;31m20221209193625908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193625908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193625909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193625909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193625909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193625909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193625920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193625929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193625929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193625929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:28.998912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7336): Terminating (SIGTERM) 19:36:29.037502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7339): Terminating (SIGTERM) 19:36:29.076183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7342): Terminating (SIGTERM) 19:36:29.115041 --- ParallelTerminationStrategy: PID 7336 died... 19:36:29.133805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7336): Terminated: ok {rc=0} 19:36:29.176494 --- ParallelTerminationStrategy: PID 7339 died... 19:36:29.194490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7339): Terminated: ok {rc=0} 19:36:29.237168 --- ParallelTerminationStrategy: PID 7342 died... 19:36:29.255139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7342): Terminated: ok {rc=0} 19:36:29.336608 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:36:30.640881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:30.647969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:36:30.680706 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:36:30.720626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:36:30.809432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:36:30.849608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:36:30.897665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:36:31.505689 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:36:31.572129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:31.584567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:36:31.656182 tst cs_paging_gprs_active.py: using LAC 23250 19:36:31.818388 tst cs_paging_gprs_active.py: using RAC 45 19:36:31.944119 tst cs_paging_gprs_active.py: using CellId 23250 19:36:32.069321 tst cs_paging_gprs_active.py: using BVCI 23251 19:36:32.189632 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.201685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.213550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.226181 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.239469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.252211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.264756 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.276863 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:32.289416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:32.408098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:32.528690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:36:32.744765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:33.052613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Launched 19:36:33.319585 run iperf3-srv_10.42.42.10(pid=7348): Launched 19:36:33.435014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:36:33.640524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:33.967468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Launched 19:36:34.252019 run iperf3-srv_10.42.42.10(pid=7350): Launched 19:36:34.376038 tst cs_paging_gprs_active.py:38: start network... 19:36:34.597068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:35.102436 run create_hlr_db(pid=7351): Launched 19:36:35.227237 bus /gobi_6: Setting Powered False 19:36:36.292251 run create_hlr_db(pid=7351): Terminated: ok {rc=0} 19:36:36.745208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Launched 19:36:37.071504 run osmo-hlr_10.42.42.2(pid=7354): Launched 19:36:37.195990 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:37.755204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Launched 19:36:38.081181 run osmo-stp_10.42.42.5(pid=7357): Launched 19:36:38.206641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:38.767379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Launched 19:36:38.892662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:39.175589 run patchelf(pid=7360): Launched 19:36:39.357576 run osmo-stp_10.42.42.5(pid=7357): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] 19:36:39.496217 run osmo-stp_10.42.42.5(pid=7357): stdout: | (launched: 2022-12-09_19:36:38.021375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:39.635615 run osmo-stp_10.42.42.5(pid=7357): stderr: | [0;m[38;5;43m20221209193638209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193638210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193638210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193638210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:39.775034 run osmo-stp_10.42.42.5(pid=7357): stdout: | (launched: 2022-12-09_19:36:38.021375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:39.908110 run osmo-stp_10.42.42.5(pid=7357): stderr: | [0;m[38;5;43m20221209193638209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193638210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193638210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193638210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193638211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:40.066289 run patchelf(pid=7360): Terminating (SIGINT) 19:36:40.248552 run patchelf(pid=7360): Terminated: ok {rc=0} 19:36:40.380428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7357): Process ended prematurely: osmo-stp_10.42.42.5(pid=7357) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:36:40.391288 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:36:40.420113 run osmo-hlr_10.42.42.2(pid=7354): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7354)] 19:36:40.469733 run osmo-hlr_10.42.42.2(pid=7354): stdout: | (launched: 2022-12-09_19:36:37.011351) 19:36:40.520834 run osmo-hlr_10.42.42.2(pid=7354): stderr: | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193637207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193637220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193637228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193637228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193637229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:40.572439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Terminating (SIGTERM) 19:36:40.613918 run iperf3-srv_10.42.42.10(pid=7348): Terminating (SIGTERM) 19:36:40.655290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Terminating (SIGTERM) 19:36:40.696689 run iperf3-srv_10.42.42.10(pid=7350): Terminating (SIGTERM) 19:36:40.738317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Terminating (SIGTERM) 19:36:40.779753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Terminating (SIGTERM) 19:36:40.821221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Terminating (SIGTERM) 19:36:40.862852 --- ParallelTerminationStrategy: PID 7347 died... 19:36:40.882662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Terminated: ok {rc=0} 19:36:40.929049 --- ParallelTerminationStrategy: PID 7348 died... 19:36:40.948452 run iperf3-srv_10.42.42.10(pid=7348): Terminated {rc=256} 19:36:40.994614 --- ParallelTerminationStrategy: PID 7349 died... 19:36:41.013873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Terminated: ok {rc=0} 19:36:41.059927 --- ParallelTerminationStrategy: PID 7350 died... 19:36:41.079343 run iperf3-srv_10.42.42.10(pid=7350): Terminated {rc=256} 19:36:41.125313 --- ParallelTerminationStrategy: PID 7353 died... 19:36:41.144698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Terminated: ok {rc=0} 19:36:41.191088 --- ParallelTerminationStrategy: PID 7356 died... 19:36:41.210426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Terminated: ok {rc=0} 19:36:41.256313 --- ParallelTerminationStrategy: PID 7359 died... 19:36:41.275727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Terminated: ok {rc=0} 19:36:41.362420 bus /gobi_0: Setting Powered False 19:36:42.461688 bus /gobi_0: Setting Powered False 19:36:43.575741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:36:44.724438 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:44.736584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:36:44.807643 tst iperf3.py: using LAC 23251 19:36:44.927654 tst iperf3.py: using RAC 46 19:36:45.048718 tst iperf3.py: using CellId 23251 19:36:45.168095 tst iperf3.py: using BVCI 23252 19:36:45.278904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.290211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.301332 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.313069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.324591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.336149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.347908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.359307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:45.370987 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:45.488840 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:36:45.709921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:46.068105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7361): Launched 19:36:46.365068 run iperf3-srv_10.42.42.10(pid=7362): Launched 19:36:46.502019 tst iperf3.py:8: start network... 19:36:46.726008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:47.237261 run create_hlr_db(pid=7363): Launched 19:36:47.363092 bus /gobi_6: Setting Powered False 19:36:48.427068 run create_hlr_db(pid=7363): Terminated: ok {rc=0} 19:36:48.861982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7365): Launched 19:36:49.166912 run osmo-hlr_10.42.42.2(pid=7366): Launched 19:36:49.282163 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:49.808331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7368): Launched 19:36:50.113971 run osmo-stp_10.42.42.5(pid=7369): Launched 19:36:50.230037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:50.755644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7371): Launched 19:36:50.871415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:51.129658 run patchelf(pid=7372): Launched 19:36:51.298153 run osmo-stp_10.42.42.5(pid=7369): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7369)] 19:36:51.426473 run osmo-stp_10.42.42.5(pid=7369): stdout: | (launched: 2022-12-09_19:36:50.056610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:51.557259 run osmo-stp_10.42.42.5(pid=7369): stderr: | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193650226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:51.687093 run osmo-stp_10.42.42.5(pid=7369): stdout: | (launched: 2022-12-09_19:36:50.056610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:51.811453 run osmo-stp_10.42.42.5(pid=7369): stderr: | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193650226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193650226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193650227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:51.959153 run patchelf(pid=7372): Terminating (SIGINT) 19:36:52.130108 run patchelf(pid=7372): Terminated: ok {rc=0} 19:36:52.253299 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7369): Process ended prematurely: osmo-stp_10.42.42.5(pid=7369) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7369)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 19:36:52.262829 tst iperf3.py:8: Test FAILED (7.6 sec) 19:36:52.289646 run osmo-hlr_10.42.42.2(pid=7366): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7366)] 19:36:52.336036 run osmo-hlr_10.42.42.2(pid=7366): stdout: | (launched: 2022-12-09_19:36:49.110562) 19:36:52.384014 run osmo-hlr_10.42.42.2(pid=7366): stderr: | [0;m[1;31m20221209193649284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193649284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193649284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193649284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193649284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193649285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193649332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193649342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193649342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193649342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:52.432534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7361): Terminating (SIGTERM) 19:36:52.471693 run iperf3-srv_10.42.42.10(pid=7362): Terminating (SIGTERM) 19:36:52.510600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7365): Terminating (SIGTERM) 19:36:52.549563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7368): Terminating (SIGTERM) 19:36:52.588442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7371): Terminating (SIGTERM) 19:36:52.627596 --- ParallelTerminationStrategy: PID 7361 died... 19:36:52.646289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7361): Terminated: ok {rc=0} 19:36:52.689481 --- ParallelTerminationStrategy: PID 7362 died... 19:36:52.707706 run iperf3-srv_10.42.42.10(pid=7362): Terminated {rc=256} 19:36:52.751092 --- ParallelTerminationStrategy: PID 7365 died... 19:36:52.769329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7365): Terminated: ok {rc=0} 19:36:52.812726 --- ParallelTerminationStrategy: PID 7368 died... 19:36:52.831054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7368): Terminated: ok {rc=0} 19:36:52.873971 --- ParallelTerminationStrategy: PID 7371 died... 19:36:52.892165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7371): Terminated: ok {rc=0} 19:36:52.976119 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:36:54.123292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.134972 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:36:54.204768 tst iperf3m4.py: using LAC 23252 19:36:54.322944 tst iperf3m4.py: using RAC 47 19:36:54.441876 tst iperf3m4.py: using CellId 23252 19:36:54.559210 tst iperf3m4.py: using BVCI 23253 19:36:54.670434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.681551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.692362 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.703175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.713979 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.724645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.735584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.746272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:36:54.757203 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:54.875380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:54.995672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:55.112078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:36:55.231418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:36:55.453178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:55.780435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7373): Launched 19:36:56.065433 run iperf3-srv_10.42.42.10(pid=7374): Launched 19:36:56.188436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:36:56.409361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:56.736704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7375): Launched 19:36:57.021221 run iperf3-srv_10.42.42.10(pid=7376): Launched 19:36:57.143047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:36:57.362703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:57.691905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Launched 19:36:57.975176 run iperf3-srv_10.42.42.10(pid=7378): Launched 19:36:58.098684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:36:58.319000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:58.647440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Launched 19:36:58.932285 run iperf3-srv_10.42.42.10(pid=7380): Launched 19:36:59.055055 tst iperf3m4.py:8: start network... 19:36:59.274561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:59.781995 run create_hlr_db(pid=7381): Launched 19:36:59.907220 bus /gobi_6: Setting Powered False 19:37:00.999113 run create_hlr_db(pid=7381): Terminated: ok {rc=0} 19:37:01.457625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Launched 19:37:01.799894 run osmo-hlr_10.42.42.2(pid=7384): Launched 19:37:02.019147 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:02.634422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Launched 19:37:02.939752 run osmo-stp_10.42.42.5(pid=7387): Launched 19:37:03.055873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:03.581191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Launched 19:37:03.697660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:03.956117 run patchelf(pid=7390): Launched 19:37:04.124871 run osmo-stp_10.42.42.5(pid=7387): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] 19:37:04.254007 run osmo-stp_10.42.42.5(pid=7387): stdout: | (launched: 2022-12-09_19:37:02.883126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:04.384478 run osmo-stp_10.42.42.5(pid=7387): stderr: | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193703052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:04.515043 run osmo-stp_10.42.42.5(pid=7387): stdout: | (launched: 2022-12-09_19:37:02.883126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:04.639891 run osmo-stp_10.42.42.5(pid=7387): stderr: | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193703051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193703052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193703052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:04.787744 run patchelf(pid=7390): Terminating (SIGINT) 19:37:04.958290 run patchelf(pid=7390): Terminated: ok {rc=0} 19:37:05.081300 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7387): Process ended prematurely: osmo-stp_10.42.42.5(pid=7387) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:37:05.090876 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:37:05.118174 run osmo-hlr_10.42.42.2(pid=7384): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7384)] 19:37:05.165007 run osmo-hlr_10.42.42.2(pid=7384): stdout: | (launched: 2022-12-09_19:37:01.737759) 19:37:05.213513 run osmo-hlr_10.42.42.2(pid=7384): stderr: | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193702041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193702103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193702119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193702120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193702120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:05.262411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7373): Terminating (SIGTERM) 19:37:05.301529 run iperf3-srv_10.42.42.10(pid=7374): Terminating (SIGTERM) 19:37:05.340516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7375): Terminating (SIGTERM) 19:37:05.379678 run iperf3-srv_10.42.42.10(pid=7376): Terminating (SIGTERM) 19:37:05.418876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Terminating (SIGTERM) 19:37:05.458094 run iperf3-srv_10.42.42.10(pid=7378): Terminating (SIGTERM) 19:37:05.497208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Terminating (SIGTERM) 19:37:05.536508 run iperf3-srv_10.42.42.10(pid=7380): Terminating (SIGTERM) 19:37:05.575613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Terminating (SIGTERM) 19:37:05.615712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Terminating (SIGTERM) 19:37:05.654890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Terminating (SIGTERM) 19:37:05.694770 --- ParallelTerminationStrategy: PID 7373 died... 19:37:05.713722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7373): Terminated: ok {rc=0} 19:37:05.757628 --- ParallelTerminationStrategy: PID 7374 died... 19:37:05.775955 run iperf3-srv_10.42.42.10(pid=7374): Terminated {rc=256} 19:37:05.819637 --- ParallelTerminationStrategy: PID 7375 died... 19:37:05.838051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7375): Terminated: ok {rc=0} 19:37:05.881368 --- ParallelTerminationStrategy: PID 7376 died... 19:37:05.899842 run iperf3-srv_10.42.42.10(pid=7376): Terminated {rc=256} 19:37:05.943082 --- ParallelTerminationStrategy: PID 7377 died... 19:37:05.961481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Terminated: ok {rc=0} 19:37:06.004791 --- ParallelTerminationStrategy: PID 7378 died... 19:37:06.023208 run iperf3-srv_10.42.42.10(pid=7378): Terminated {rc=256} 19:37:06.066635 --- ParallelTerminationStrategy: PID 7379 died... 19:37:06.085064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Terminated: ok {rc=0} 19:37:06.128638 --- ParallelTerminationStrategy: PID 7380 died... 19:37:06.147075 run iperf3-srv_10.42.42.10(pid=7380): Terminated {rc=256} 19:37:06.190585 --- ParallelTerminationStrategy: PID 7383 died... 19:37:06.209111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Terminated: ok {rc=0} 19:37:06.253071 --- ParallelTerminationStrategy: PID 7386 died... 19:37:06.271599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Terminated: ok {rc=0} 19:37:06.315073 --- ParallelTerminationStrategy: PID 7389 died... 19:37:06.333617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Terminated: ok {rc=0} 19:37:06.419116 bus /gobi_4: Setting Powered False 19:37:07.518580 bus /gobi_4: Setting Powered False 19:37:08.634255 bus /gobi_1: Setting Powered False 19:37:09.732150 bus /gobi_1: Setting Powered False 19:37:10.845211 bus /gobi_0: Setting Powered False 19:37:11.939235 bus /gobi_0: Setting Powered False 19:37:13.052236 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:37:14.153794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.165728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:37:14.232687 tst ping.py: using LAC 23253 19:37:14.356781 tst ping.py: using RAC 48 19:37:14.474396 tst ping.py: using CellId 23253 19:37:14.596746 tst ping.py: using BVCI 23254 19:37:14.706807 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.717832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.728543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.739601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.750486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.761443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.772435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:14.783403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:37:14.897562 tst ping.py:19: start network... 19:37:15.097865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:15.560326 run create_hlr_db(pid=7391): Launched 19:37:15.682604 bus /gobi_6: Setting Powered False 19:37:16.745364 run create_hlr_db(pid=7391): Terminated: ok {rc=0} 19:37:17.204213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Launched 19:37:17.526317 run osmo-hlr_10.42.42.2(pid=7394): Launched 19:37:17.649117 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:18.202945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Launched 19:37:18.525610 run osmo-stp_10.42.42.5(pid=7397): Launched 19:37:18.647796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:19.200930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Launched 19:37:19.322878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:19.594163 run patchelf(pid=7400): Launched 19:37:19.773817 run osmo-stp_10.42.42.5(pid=7397): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] 19:37:19.909331 run osmo-stp_10.42.42.5(pid=7397): stdout: | (launched: 2022-12-09_19:37:18.466236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:20.046229 run osmo-stp_10.42.42.5(pid=7397): stderr: | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193718658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:20.183182 run osmo-stp_10.42.42.5(pid=7397): stdout: | (launched: 2022-12-09_19:37:18.466236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:20.314483 run osmo-stp_10.42.42.5(pid=7397): stderr: | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193718657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193718658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193718658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:20.470282 run patchelf(pid=7400): Terminating (SIGINT) 19:37:20.648362 run patchelf(pid=7400): Terminated: ok {rc=0} 19:37:20.776791 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7397): Process ended prematurely: osmo-stp_10.42.42.5(pid=7397) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 19:37:20.786565 tst ping.py:22: Test FAILED (6.6 sec) 19:37:20.814829 run osmo-hlr_10.42.42.2(pid=7394): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7394)] 19:37:20.864081 run osmo-hlr_10.42.42.2(pid=7394): stdout: | (launched: 2022-12-09_19:37:17.466856) 19:37:20.915086 run osmo-hlr_10.42.42.2(pid=7394): stderr: | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193717663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193717674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193717683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193717683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193717683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:20.966913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Terminating (SIGTERM) 19:37:21.008278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Terminating (SIGTERM) 19:37:21.049938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Terminating (SIGTERM) 19:37:21.091642 --- ParallelTerminationStrategy: PID 7393 died... 19:37:21.111527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Terminated: ok {rc=0} 19:37:21.157853 --- ParallelTerminationStrategy: PID 7396 died... 19:37:21.177312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Terminated: ok {rc=0} 19:37:21.223100 --- ParallelTerminationStrategy: PID 7399 died... 19:37:21.242451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Terminated: ok {rc=0} 19:37:21.329808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:37:22.416544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:22.429449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:37:22.498872 tst ping_idle_ping.py: using LAC 23254 19:37:22.625364 tst ping_idle_ping.py: using RAC 49 19:37:22.750046 tst ping_idle_ping.py: using CellId 23254 19:37:22.876818 tst ping_idle_ping.py: using BVCI 23255 19:37:22.993003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.004566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.015995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.027593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.039211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.050809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.062552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:23.074222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:37:23.188546 tst ping_idle_ping.py:24: start network... 19:37:23.390196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:23.858509 run create_hlr_db(pid=7401): Launched 19:37:23.983316 bus /gobi_6: Setting Powered False 19:37:25.043271 run create_hlr_db(pid=7401): Terminated: ok {rc=0} 19:37:25.481505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7403): Launched 19:37:25.803922 run osmo-hlr_10.42.42.2(pid=7404): Launched 19:37:25.927046 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:26.485034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7406): Launched 19:37:26.805706 run osmo-stp_10.42.42.5(pid=7407): Launched 19:37:26.927342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:27.480518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7409): Launched 19:37:27.603547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:27.874647 run patchelf(pid=7410): Launched 19:37:28.053771 run osmo-stp_10.42.42.5(pid=7407): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7407)] 19:37:28.189349 run osmo-stp_10.42.42.5(pid=7407): stdout: | (launched: 2022-12-09_19:37:26.746522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:28.326300 run osmo-stp_10.42.42.5(pid=7407): stderr: | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193726939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:28.464157 run osmo-stp_10.42.42.5(pid=7407): stdout: | (launched: 2022-12-09_19:37:26.746522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:28.595592 run osmo-stp_10.42.42.5(pid=7407): stderr: | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193726938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193726939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193726939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:28.751338 run patchelf(pid=7410): Terminating (SIGINT) 19:37:28.929842 run patchelf(pid=7410): Terminated: ok {rc=0} 19:37:29.058547 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7407): Process ended prematurely: osmo-stp_10.42.42.5(pid=7407) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7407)] [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:37:29.068272 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:37:29.096648 run osmo-hlr_10.42.42.2(pid=7404): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7404)] 19:37:29.146249 run osmo-hlr_10.42.42.2(pid=7404): stdout: | (launched: 2022-12-09_19:37:25.744583) 19:37:29.197669 run osmo-hlr_10.42.42.2(pid=7404): stderr: | [0;m[1;31m20221209193725943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193725944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193725944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193725944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193725944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193725944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193725961 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193725970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193725970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193725970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:29.249606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7403): Terminating (SIGTERM) 19:37:29.290920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7406): Terminating (SIGTERM) 19:37:29.332553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7409): Terminating (SIGTERM) 19:37:29.374329 --- ParallelTerminationStrategy: PID 7403 died... 19:37:29.394198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7403): Terminated: ok {rc=0} 19:37:29.440614 --- ParallelTerminationStrategy: PID 7406 died... 19:37:29.460115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7406): Terminated: ok {rc=0} 19:37:29.506128 --- ParallelTerminationStrategy: PID 7409 died... 19:37:29.525439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7409): Terminated: ok {rc=0} 19:37:29.612011 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:37:30.947611 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:30.957978 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:37:30.990650 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:37:31.030666 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:37:31.086685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:37:31.122434 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:37:31.164334 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:37:31.716424 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:37:31.725237 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:31.737464 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:37:31.804034 tst switch_tch_pdch.py: using LAC 23255 19:37:31.933912 tst switch_tch_pdch.py: using RAC 50 19:37:32.096158 tst switch_tch_pdch.py: using CellId 23255 19:37:32.227498 tst switch_tch_pdch.py: using BVCI 23256 19:37:32.347172 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.359584 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.371789 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.384311 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.396829 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.409425 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.421736 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:37:32.433784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:37:32.551484 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:37:32.666923 tst switch_tch_pdch.py:51: start network... 19:37:32.866705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:33.331477 run create_hlr_db(pid=7414): Launched 19:37:33.453510 bus /gobi_6: Setting Powered False 19:37:34.516695 run create_hlr_db(pid=7414): Terminated: ok {rc=0} 19:37:34.961996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7416): Launched 19:37:35.282457 run osmo-hlr_10.42.42.2(pid=7417): Launched 19:37:35.406263 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:35.951887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Launched 19:37:36.250687 run osmo-stp_10.42.42.5(pid=7421): Launched 19:37:36.364142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:36.880403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Launched 19:37:36.994612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:37.247485 run patchelf(pid=7424): Launched 19:37:37.414286 run osmo-stp_10.42.42.5(pid=7421): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] 19:37:37.541091 run osmo-stp_10.42.42.5(pid=7421): stdout: | (launched: 2022-12-09_19:37:36.195070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:37.668817 run osmo-stp_10.42.42.5(pid=7421): stderr: | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193736363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:37.796712 run osmo-stp_10.42.42.5(pid=7421): stdout: | (launched: 2022-12-09_19:37:36.195070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:37.919950 run osmo-stp_10.42.42.5(pid=7421): stderr: | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193736363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193736363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193736364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:38.064780 run patchelf(pid=7424): Terminating (SIGINT) 19:37:38.231611 run patchelf(pid=7424): Terminated: ok {rc=0} 19:37:38.352523 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7421): Process ended prematurely: osmo-stp_10.42.42.5(pid=7421) [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:37:38.361702 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:37:38.387746 run osmo-hlr_10.42.42.2(pid=7417): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7417)] 19:37:38.434675 run osmo-hlr_10.42.42.2(pid=7417): stdout: | (launched: 2022-12-09_19:37:35.223493) 19:37:38.483084 run osmo-hlr_10.42.42.2(pid=7417): stderr: | [0;m[1;31m20221209193735419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193735419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193735419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193735420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193735420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193735420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193735432 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193735441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193735441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193735441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:38.531640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7416): Terminating (SIGTERM) 19:37:38.570530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Terminating (SIGTERM) 19:37:38.609416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Terminating (SIGTERM) 19:37:38.649038 --- ParallelTerminationStrategy: PID 7416 died... 19:37:38.667823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7416): Terminated: ok {rc=0} 19:37:38.711224 --- ParallelTerminationStrategy: PID 7420 died... 19:37:38.729856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7420): Terminated: ok {rc=0} 19:37:38.772713 --- ParallelTerminationStrategy: PID 7423 died... 19:37:38.791033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7423): Terminated: ok {rc=0} 19:37:38.874366 bus /gobi_0: Setting Powered False 19:37:39.973890 bus /gobi_0: Setting Powered False 19:37:41.087078 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:37:42.348431 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:42.355423 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:37:42.384617 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:37:42.418472 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:37:42.471516 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:37:42.501115 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:37:42.535013 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:37:43.094087 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:37:43.099687 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.111273 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:37:43.178649 tst switch_tch_pdch.py: using LAC 23256 19:37:43.307531 tst switch_tch_pdch.py: using RAC 51 19:37:43.432077 tst switch_tch_pdch.py: using CellId 23256 19:37:43.556865 tst switch_tch_pdch.py: using BVCI 23257 19:37:43.672743 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.684381 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.695772 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.707462 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.719213 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.731027 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.742893 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:37:43.754793 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:37:43.871631 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:37:43.989491 tst switch_tch_pdch.py:51: start network... 19:37:44.204687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:44.672171 run create_hlr_db(pid=7429): Launched 19:37:44.793698 bus /gobi_6: Setting Powered False 19:37:45.859233 run create_hlr_db(pid=7429): Terminated: ok {rc=0} 19:37:46.289686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Launched 19:37:46.675797 run osmo-hlr_10.42.42.2(pid=7432): Launched 19:37:46.873516 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:47.602341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Launched 19:37:47.902539 run osmo-stp_10.42.42.5(pid=7435): Launched 19:37:48.018422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:48.507455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Launched 19:37:48.620668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:48.873933 run patchelf(pid=7438): Launched 19:37:49.038763 run osmo-stp_10.42.42.5(pid=7435): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] 19:37:49.165187 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-09_19:37:47.846814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:49.292323 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193748015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:49.420007 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-09_19:37:47.846814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:49.541954 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193748015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193748015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193748016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:49.686707 run patchelf(pid=7438): Terminating (SIGINT) 19:37:49.853503 run patchelf(pid=7438): Terminated: ok {rc=0} 19:37:49.974522 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:37:49.983371 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:37:50.009674 run osmo-hlr_10.42.42.2(pid=7432): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7432)] 19:37:50.056582 run osmo-hlr_10.42.42.2(pid=7432): stdout: | (launched: 2022-12-09_19:37:46.611436) 19:37:50.105051 run osmo-hlr_10.42.42.2(pid=7432): stderr: | [0;m[1;31m20221209193746961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193746961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193746961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193746963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193746963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193746963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193746993 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193747016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193747016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193747016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:50.153654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminating (SIGTERM) 19:37:50.192801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminating (SIGTERM) 19:37:50.231958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminating (SIGTERM) 19:37:50.271275 --- ParallelTerminationStrategy: PID 7431 died... 19:37:50.290045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminated: ok {rc=0} 19:37:50.333331 --- ParallelTerminationStrategy: PID 7434 died... 19:37:50.351612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminated: ok {rc=0} 19:37:50.394677 --- ParallelTerminationStrategy: PID 7437 died... 19:37:50.412839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminated: ok {rc=0} 19:37:50.495954 bus /gobi_0: Setting Powered False 19:37:51.595028 bus /gobi_0: Setting Powered False 19:37:52.708302 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_sms:nanobts --------------------------------------------------------------------- 19:37:53.955165 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:53.959182 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 19:37:53.983121 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 19:37:53.990048 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 19:37:54.040611 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 19:37:54.063762 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 19:37:54.070257 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 19:37:54.607967 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 19:37:54.613109 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 19:37:54.623833 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 19:37:54.661140 tst mo_mt_sms.py: using LAC 23257 19:37:54.778170 tst mo_mt_sms.py: using RAC 52 19:37:54.897087 tst mo_mt_sms.py: using CellId 23257 19:37:55.013706 tst mo_mt_sms.py: using BVCI 23258 19:37:55.131505 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 19:37:55.244156 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 19:37:55.363235 tst mo_mt_sms.py:9: start nitb and bts... 19:37:55.564848 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:37:56.176728 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7442): Launched 19:37:56.476364 run osmo-nitb_10.42.42.2(pid=7443): Launched 19:37:56.641251 run osmo-nitb_10.42.42.2(pid=7443): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7443)] 19:37:56.774652 run osmo-nitb_10.42.42.2(pid=7443): stdout: | (launched: 2022-12-09_19:37:56.420673) 19:37:56.909628 run osmo-nitb_10.42.42.2(pid=7443): stderr: | (launched: 2022-12-09_19:37:56.465325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:37:57.044737 run osmo-nitb_10.42.42.2(pid=7443): stdout: | (launched: 2022-12-09_19:37:56.420673) 19:37:57.173932 run osmo-nitb_10.42.42.2(pid=7443): stderr: | (launched: 2022-12-09_19:37:56.465325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7443): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7443) [trial-2363↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7443)] 19:37:57.588942 tst osmo-nitb_10.42.42.2(pid=7443): stdout: | (launched: 2022-12-09_19:37:56.420673) 19:37:57.709551 tst osmo-nitb_10.42.42.2(pid=7443): stderr: | (launched: 2022-12-09_19:37:56.465325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:37:57.851635 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7443): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7443) [trial-2363↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7443)] [trial-2363↪nitb_sms:nanobts↪mo_mt_sms.py:11] 19:37:57.860200 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 19:37:57.867016 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7442): Terminating (SIGTERM) 19:37:58.074969 --- ParallelTerminationStrategy: PID 7442 died... 19:37:58.095643 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7442): Terminated: ok {rc=0} 19:37:58.180212 bus /sierra_3: Setting Powered False 19:37:59.283126 bus /sierra_3: Setting Powered False 19:38:00.399941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:nanobts+band-1900 --------------------------------------------------------------------- 19:38:01.590515 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:01.596285 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:38:01.621202 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:38:01.648687 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 19:38:01.700598 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:38:01.746444 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:38:01.776589 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 19:38:02.352561 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 19:38:02.358995 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:02.373636 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:38:02.418378 tst mo_mt_sms.py: using LAC 23258 19:38:02.569793 tst mo_mt_sms.py: using RAC 53 19:38:02.707894 tst mo_mt_sms.py: using CellId 23258 19:38:02.827882 tst mo_mt_sms.py: using BVCI 23259 19:38:02.950594 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:02.961907 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:02.972780 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:02.983916 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:02.994920 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:03.005917 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 19:38:03.126175 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 19:38:03.255565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:03.842126 run create_hlr_db(pid=7578): Launched 19:38:04.028309 bus /sierra_2: Setting Powered False 19:38:05.090485 run create_hlr_db(pid=7578): Terminated: ok {rc=0} 19:38:05.555638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Launched 19:38:05.879005 run osmo-hlr_10.42.42.2(pid=7720): Launched 19:38:06.115604 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:06.819567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Launched 19:38:07.137204 run osmo-stp_10.42.42.5(pid=7725): Launched 19:38:07.371458 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:08.080394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Launched 19:38:08.401662 run osmo-msc_10.42.42.6(pid=7728): Launched 19:38:08.746415 run osmo-stp_10.42.42.5(pid=7725): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] 19:38:09.014635 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-09_19:38:07.080200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:09.286691 run osmo-stp_10.42.42.5(pid=7725): stderr: | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193807403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:09.454659 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-09_19:38:07.080200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:09.577592 run osmo-stp_10.42.42.5(pid=7725): stderr: | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193807403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193807403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193807404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:09.727765 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 19:38:09.737215 tst mo_mt_sms.py:16: Test FAILED (7.4 sec) 19:38:09.764212 run osmo-hlr_10.42.42.2(pid=7720): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7720)] 19:38:09.813117 run osmo-hlr_10.42.42.2(pid=7720): stdout: | (launched: 2022-12-09_19:38:05.820652) 19:38:09.865196 run osmo-hlr_10.42.42.2(pid=7720): stderr: | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193806155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193806169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193806186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193806186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193806186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:09.935805 run osmo-msc_10.42.42.6(pid=7728): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7728)] 19:38:09.984593 run osmo-msc_10.42.42.6(pid=7728): stdout: | (launched: 2022-12-09_19:38:08.343306) 19:38:10.034903 run osmo-msc_10.42.42.6(pid=7728): stderr: | [0;m[38;5;43m20221209193808926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193808926 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f913eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193808926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193808926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193808927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193808927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193808928 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193808937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193808937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193808937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:10.086547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Terminating (SIGTERM) 19:38:10.129152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminating (SIGTERM) 19:38:10.172262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminating (SIGTERM) 19:38:10.216387 --- ParallelTerminationStrategy: PID 7719 died... 19:38:10.236525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Terminated: ok {rc=0} 19:38:10.285122 --- ParallelTerminationStrategy: PID 7724 died... 19:38:10.304588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminated: ok {rc=0} 19:38:10.350604 --- ParallelTerminationStrategy: PID 7727 died... 19:38:10.370121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminated: ok {rc=0} 19:38:10.458453 bus /sierra_3: Setting Powered False 19:38:11.558187 bus /sierra_3: Setting Powered False 19:38:12.675070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 19:38:13.900825 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:13.906206 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:38:13.932018 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 19:38:13.939201 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 19:38:13.973101 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:38:13.997692 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 19:38:14.005282 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 19:38:14.524494 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 19:38:14.531016 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 19:38:14.542801 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:38:14.582525 tst assert_extension.py: using LAC 23259 19:38:14.705346 tst assert_extension.py: using RAC 54 19:38:14.825365 tst assert_extension.py: using CellId 23259 19:38:14.946058 tst assert_extension.py: using BVCI 23260 19:38:15.059090 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 19:38:15.176495 tst assert_extension.py:10: start nitb and bts... 19:38:15.388621 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:38:16.050744 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7733): Launched 19:38:16.477696 run osmo-nitb_10.42.42.2(pid=7734): Launched 19:38:16.705190 run osmo-nitb_10.42.42.2(pid=7734): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7734)] 19:38:16.851516 run osmo-nitb_10.42.42.2(pid=7734): stdout: | (launched: 2022-12-09_19:38:16.399164) 19:38:17.000146 run osmo-nitb_10.42.42.2(pid=7734): stderr: | (launched: 2022-12-09_19:38:16.455073) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:38:17.148676 run osmo-nitb_10.42.42.2(pid=7734): stdout: | (launched: 2022-12-09_19:38:16.399164) 19:38:17.291628 run osmo-nitb_10.42.42.2(pid=7734): stderr: | (launched: 2022-12-09_19:38:16.455073) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7734) [trial-2363↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7734)] 19:38:17.647363 tst osmo-nitb_10.42.42.2(pid=7734): stdout: | (launched: 2022-12-09_19:38:16.399164) 19:38:17.802459 tst osmo-nitb_10.42.42.2(pid=7734): stderr: | (launched: 2022-12-09_19:38:16.455073) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:38:17.985859 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7734) [trial-2363↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7734)] [trial-2363↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 19:38:17.995547 tst assert_extension.py:12: Test FAILED (3.5 sec) 19:38:18.003207 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7733): Terminating (SIGTERM) 19:38:18.216711 --- ParallelTerminationStrategy: PID 7733 died... 19:38:18.238339 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7733): Terminated: ok {rc=0} 19:38:18.329603 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:nanobts+band-1900 --------------------------------------------------------------------- 19:38:19.502615 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:19.508656 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:38:19.536248 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:38:19.565421 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 19:38:19.601140 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:38:19.626671 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:38:19.656191 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 19:38:20.183909 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 19:38:20.190766 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.202947 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:38:20.249427 tst assert_extension.py: using LAC 23260 19:38:20.368252 tst assert_extension.py: using RAC 55 19:38:20.488509 tst assert_extension.py: using CellId 23260 19:38:20.607328 tst assert_extension.py: using BVCI 23261 19:38:20.719301 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.731020 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.742680 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.754394 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.766048 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:38:20.777736 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 19:38:20.895061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:21.370452 run create_hlr_db(pid=7738): Launched 19:38:21.529627 bus /sierra_2: Setting Powered False 19:38:22.592590 run create_hlr_db(pid=7738): Terminated: ok {rc=0} 19:38:23.033370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7740): Launched 19:38:23.363142 run osmo-hlr_10.42.42.2(pid=7741): Launched 19:38:23.603365 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:24.315285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7743): Launched 19:38:24.642898 run osmo-stp_10.42.42.5(pid=7744): Launched 19:38:24.809585 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:25.391728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7746): Launched 19:38:25.716259 run osmo-msc_10.42.42.6(pid=7747): Launched 19:38:25.896489 run osmo-stp_10.42.42.5(pid=7744): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7744)] 19:38:26.031857 run osmo-stp_10.42.42.5(pid=7744): stdout: | (launched: 2022-12-09_19:38:24.585718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:26.167496 run osmo-stp_10.42.42.5(pid=7744): stderr: | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193824820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:26.303466 run osmo-stp_10.42.42.5(pid=7744): stdout: | (launched: 2022-12-09_19:38:24.585718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:26.432429 run osmo-stp_10.42.42.5(pid=7744): stderr: | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193824819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193824820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193824821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:26.586725 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7744): Process ended prematurely: osmo-stp_10.42.42.5(pid=7744) [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7744)] [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py:17] 19:38:26.595866 tst assert_extension.py:17: Test FAILED (6.4 sec) 19:38:26.624882 run osmo-hlr_10.42.42.2(pid=7741): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7741)] 19:38:26.675816 run osmo-hlr_10.42.42.2(pid=7741): stdout: | (launched: 2022-12-09_19:38:23.301450) 19:38:26.727935 run osmo-hlr_10.42.42.2(pid=7741): stderr: | [0;m[1;31m20221209193823640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193823640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193823640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193823645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193823645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193823645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193823664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193823677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193823678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193823678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:26.800599 run osmo-msc_10.42.42.6(pid=7747): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7747)] 19:38:26.850782 run osmo-msc_10.42.42.6(pid=7747): stdout: | (launched: 2022-12-09_19:38:25.656643) 19:38:26.902438 run osmo-msc_10.42.42.6(pid=7747): stderr: | [0;m[38;5;43m20221209193825978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193825978 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf66747c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193825978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193825978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193825978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193825978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193825980 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193825981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193825981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193825981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:26.954594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7740): Terminating (SIGTERM) 19:38:26.996370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7743): Terminating (SIGTERM) 19:38:27.038378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7746): Terminating (SIGTERM) 19:38:27.080305 --- ParallelTerminationStrategy: PID 7740 died... 19:38:27.100407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7740): Terminated: ok {rc=0} 19:38:27.147532 --- ParallelTerminationStrategy: PID 7743 died... 19:38:27.167149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7743): Terminated: ok {rc=0} 19:38:27.213669 --- ParallelTerminationStrategy: PID 7746 died... 19:38:27.233224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7746): Terminated: ok {rc=0} 19:38:27.321528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:38:28.524858 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:28.533133 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:38:28.558987 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:38:28.586269 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:38:28.639429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:38:28.663790 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:38:28.691266 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:38:29.243025 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:38:29.296686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.308468 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:38:29.369308 tst mo_mt_call.py: using LAC 23261 19:38:29.502333 tst mo_mt_call.py: using RAC 56 19:38:29.629332 tst mo_mt_call.py: using CellId 23261 19:38:29.754614 tst mo_mt_call.py: using BVCI 23262 19:38:29.874202 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.885823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.897266 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.908762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.922392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:29.934929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:38:30.051595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:38:30.171015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:30.678454 run create_hlr_db(pid=7752): Launched 19:38:30.803759 bus /sierra_2: Setting Powered False 19:38:31.867844 run create_hlr_db(pid=7752): Terminated: ok {rc=0} 19:38:32.361750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Launched 19:38:32.690078 run osmo-hlr_10.42.42.2(pid=7756): Launched 19:38:32.815497 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:33.379914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Launched 19:38:33.708009 run osmo-stp_10.42.42.5(pid=7759): Launched 19:38:33.832928 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:34.423929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7761): Launched 19:38:34.754532 run osmo-msc_10.42.42.6(pid=7762): Launched 19:38:34.938029 run osmo-stp_10.42.42.5(pid=7759): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] 19:38:35.075845 run osmo-stp_10.42.42.5(pid=7759): stdout: | (launched: 2022-12-09_19:38:33.647929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:35.214164 run osmo-stp_10.42.42.5(pid=7759): stderr: | [0;m[38;5;43m20221209193833839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193833840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193833840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193833840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:35.351389 run osmo-stp_10.42.42.5(pid=7759): stdout: | (launched: 2022-12-09_19:38:33.647929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:35.482037 run osmo-stp_10.42.42.5(pid=7759): stderr: | [0;m[38;5;43m20221209193833839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193833840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193833840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193833840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193833841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:35.638476 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7759): Process ended prematurely: osmo-stp_10.42.42.5(pid=7759) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:38:35.648215 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:38:35.676699 run osmo-hlr_10.42.42.2(pid=7756): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7756)] 19:38:35.726685 run osmo-hlr_10.42.42.2(pid=7756): stdout: | (launched: 2022-12-09_19:38:32.629650) 19:38:35.778312 run osmo-hlr_10.42.42.2(pid=7756): stderr: | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193832829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193832842 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193832851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193832851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193832851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:35.849860 run osmo-msc_10.42.42.6(pid=7762): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7762)] 19:38:35.899411 run osmo-msc_10.42.42.6(pid=7762): stdout: | (launched: 2022-12-09_19:38:34.694079) 19:38:35.950594 run osmo-msc_10.42.42.6(pid=7762): stderr: | [0;m[38;5;43m20221209193835017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193835017 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8f18a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193835017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193835017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193835017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193835017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193835019 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193835019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193835019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193835020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:36.002125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Terminating (SIGTERM) 19:38:36.043516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Terminating (SIGTERM) 19:38:36.085256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7761): Terminating (SIGTERM) 19:38:36.127165 --- ParallelTerminationStrategy: PID 7755 died... 19:38:36.146962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Terminated: ok {rc=0} 19:38:36.193322 --- ParallelTerminationStrategy: PID 7758 died... 19:38:36.212834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Terminated: ok {rc=0} 19:38:36.258951 --- ParallelTerminationStrategy: PID 7761 died... 19:38:36.278315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7761): Terminated: ok {rc=0} 19:38:36.365694 bus /sierra_3: Setting Powered False 19:38:37.464041 bus /sierra_3: Setting Powered False 19:38:38.578778 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:38:39.725356 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:39.737435 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:38:39.798026 tst mo_mt_call_osmux.py: using LAC 23262 19:38:39.919643 tst mo_mt_call_osmux.py: using RAC 57 19:38:40.044389 tst mo_mt_call_osmux.py: using CellId 23262 19:38:40.164460 tst mo_mt_call_osmux.py: using BVCI 23263 19:38:40.275112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:40.286309 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:40.297390 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:40.308569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:40.319860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:38:40.331417 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:38:40.447305 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:38:40.564657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:41.044068 run create_hlr_db(pid=7764): Launched 19:38:41.168534 bus /sierra_2: Setting Powered False 19:38:42.230014 run create_hlr_db(pid=7764): Terminated: ok {rc=0} 19:38:42.658891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7766): Launched 19:38:42.965911 run osmo-hlr_10.42.42.2(pid=7767): Launched 19:38:43.081768 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:43.623067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7769): Launched 19:38:43.932361 run osmo-stp_10.42.42.5(pid=7770): Launched 19:38:44.049098 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:44.604883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7772): Launched 19:38:44.911419 run osmo-msc_10.42.42.6(pid=7773): Launched 19:38:45.083722 run osmo-stp_10.42.42.5(pid=7770): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7770)] 19:38:45.212187 run osmo-stp_10.42.42.5(pid=7770): stdout: | (launched: 2022-12-09_19:38:43.874763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:45.340752 run osmo-stp_10.42.42.5(pid=7770): stderr: | [0;m[38;5;43m20221209193844046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193844046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193844047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193844048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:45.467465 run osmo-stp_10.42.42.5(pid=7770): stdout: | (launched: 2022-12-09_19:38:43.874763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:45.588781 run osmo-stp_10.42.42.5(pid=7770): stderr: | [0;m[38;5;43m20221209193844046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193844046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193844047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193844048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193844048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:45.734445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7770): Process ended prematurely: osmo-stp_10.42.42.5(pid=7770) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7770)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:38:45.743303 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:38:45.769356 run osmo-hlr_10.42.42.2(pid=7767): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7767)] 19:38:45.816033 run osmo-hlr_10.42.42.2(pid=7767): stdout: | (launched: 2022-12-09_19:38:42.908763) 19:38:45.879436 run osmo-hlr_10.42.42.2(pid=7767): stderr: | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193843085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193843097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193843106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193843106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193843106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:45.956927 run osmo-msc_10.42.42.6(pid=7773): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7773)] 19:38:46.009192 run osmo-msc_10.42.42.6(pid=7773): stdout: | (launched: 2022-12-09_19:38:44.854501) 19:38:46.063713 run osmo-msc_10.42.42.6(pid=7773): stderr: | [0;m[38;5;43m20221209193845126 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193845126 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1e51b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193845126 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193845126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193845126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193845127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193845128 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193845129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193845129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193845129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:46.118262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7766): Terminating (SIGTERM) 19:38:46.162430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7769): Terminating (SIGTERM) 19:38:46.206941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7772): Terminating (SIGTERM) 19:38:46.255062 --- ParallelTerminationStrategy: PID 7766 died... 19:38:46.276098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7766): Terminated: ok {rc=0} 19:38:46.326829 --- ParallelTerminationStrategy: PID 7769 died... 19:38:46.347780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7769): Terminated: ok {rc=0} 19:38:46.397086 --- ParallelTerminationStrategy: PID 7772 died... 19:38:46.418527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7772): Terminated: ok {rc=0} 19:38:46.515992 bus /sierra_3: Setting Powered False 19:38:47.616347 bus /sierra_3: Setting Powered False 19:38:48.732309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:38:49.981255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:49.989573 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:38:50.015469 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:38:50.043107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:38:50.096279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:38:50.119682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:38:50.146276 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:38:50.705530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:38:50.758870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:50.770668 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:38:50.830274 tst mo_mt_call.py: using LAC 23263 19:38:50.956436 tst mo_mt_call.py: using RAC 58 19:38:51.082162 tst mo_mt_call.py: using CellId 23263 19:38:51.208192 tst mo_mt_call.py: using BVCI 23264 19:38:51.327698 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:51.339287 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:51.350756 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:51.362708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:51.374642 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:38:51.386475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:38:51.502637 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:38:51.622558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:52.130790 run create_hlr_db(pid=7779): Launched 19:38:52.256803 bus /sierra_2: Setting Powered False 19:38:53.318224 run create_hlr_db(pid=7779): Terminated: ok {rc=0} 19:38:53.775376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Launched 19:38:54.104067 run osmo-hlr_10.42.42.2(pid=7782): Launched 19:38:54.230384 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:54.797274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Launched 19:38:55.124827 run osmo-stp_10.42.42.5(pid=7785): Launched 19:38:55.252226 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:55.846284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7787): Launched 19:38:56.174639 run osmo-msc_10.42.42.6(pid=7788): Launched 19:38:56.358035 run osmo-stp_10.42.42.5(pid=7785): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] 19:38:56.497954 run osmo-stp_10.42.42.5(pid=7785): stdout: | (launched: 2022-12-09_19:38:55.064516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:56.635973 run osmo-stp_10.42.42.5(pid=7785): stderr: | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193855258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:56.772400 run osmo-stp_10.42.42.5(pid=7785): stdout: | (launched: 2022-12-09_19:38:55.064516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:56.902571 run osmo-stp_10.42.42.5(pid=7785): stderr: | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193855257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193855258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193855258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:57.058194 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7785): Process ended prematurely: osmo-stp_10.42.42.5(pid=7785) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:38:57.068005 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:38:57.096350 run osmo-hlr_10.42.42.2(pid=7782): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7782)] 19:38:57.146039 run osmo-hlr_10.42.42.2(pid=7782): stdout: | (launched: 2022-12-09_19:38:54.043865) 19:38:57.197368 run osmo-hlr_10.42.42.2(pid=7782): stderr: | [0;m[1;31m20221209193854241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193854241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193854242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193854242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193854242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193854242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193854255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193854265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193854265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193854265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:57.269078 run osmo-msc_10.42.42.6(pid=7788): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7788)] 19:38:57.318448 run osmo-msc_10.42.42.6(pid=7788): stdout: | (launched: 2022-12-09_19:38:56.114208) 19:38:57.369782 run osmo-msc_10.42.42.6(pid=7788): stderr: | [0;m[38;5;43m20221209193856437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193856437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb497a56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193856437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193856437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193856437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193856437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193856439 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193856439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193856440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193856440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:57.421794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Terminating (SIGTERM) 19:38:57.463606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Terminating (SIGTERM) 19:38:57.505475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7787): Terminating (SIGTERM) 19:38:57.547086 --- ParallelTerminationStrategy: PID 7781 died... 19:38:57.566945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Terminated: ok {rc=0} 19:38:57.613181 --- ParallelTerminationStrategy: PID 7784 died... 19:38:57.632525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Terminated: ok {rc=0} 19:38:57.678287 --- ParallelTerminationStrategy: PID 7787 died... 19:38:57.697619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7787): Terminated: ok {rc=0} 19:38:57.786116 bus /sierra_3: Setting Powered False 19:38:58.881792 bus /sierra_3: Setting Powered False 19:38:59.995702 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:39:01.147182 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.160111 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:39:01.222704 tst mo_mt_call_osmux.py: using LAC 23264 19:39:01.348003 tst mo_mt_call_osmux.py: using RAC 59 19:39:01.517707 tst mo_mt_call_osmux.py: using CellId 23264 19:39:01.644313 tst mo_mt_call_osmux.py: using BVCI 23265 19:39:01.767894 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.780177 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.793533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.806209 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.818442 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:39:01.831131 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:39:01.954775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:39:02.106185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:02.609781 run create_hlr_db(pid=7790): Launched 19:39:02.735031 bus /sierra_2: Setting Powered False 19:39:03.795757 run create_hlr_db(pid=7790): Terminated: ok {rc=0} 19:39:04.243638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7792): Launched 19:39:04.574530 run osmo-hlr_10.42.42.2(pid=7793): Launched 19:39:04.700807 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:05.263896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7795): Launched 19:39:05.594332 run osmo-stp_10.42.42.5(pid=7796): Launched 19:39:05.719606 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:06.313262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7798): Launched 19:39:06.645286 run osmo-msc_10.42.42.6(pid=7799): Launched 19:39:06.828703 run osmo-stp_10.42.42.5(pid=7796): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7796)] 19:39:06.966549 run osmo-stp_10.42.42.5(pid=7796): stdout: | (launched: 2022-12-09_19:39:05.533769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:07.104640 run osmo-stp_10.42.42.5(pid=7796): stderr: | [0;m[38;5;43m20221209193905727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193905727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193905728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193905728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:07.242467 run osmo-stp_10.42.42.5(pid=7796): stdout: | (launched: 2022-12-09_19:39:05.533769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:07.373865 run osmo-stp_10.42.42.5(pid=7796): stderr: | [0;m[38;5;43m20221209193905727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193905727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193905728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193905728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193905729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:07.531233 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7796): Process ended prematurely: osmo-stp_10.42.42.5(pid=7796) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7796)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:39:07.541122 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:39:07.569541 run osmo-hlr_10.42.42.2(pid=7793): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7793)] 19:39:07.619771 run osmo-hlr_10.42.42.2(pid=7793): stdout: | (launched: 2022-12-09_19:39:04.513803) 19:39:07.671482 run osmo-hlr_10.42.42.2(pid=7793): stderr: | [0;m[1;31m20221209193904714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193904714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193904714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193904714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193904714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193904715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193904727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193904735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193904735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193904735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:07.743546 run osmo-msc_10.42.42.6(pid=7799): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7799)] 19:39:07.793593 run osmo-msc_10.42.42.6(pid=7799): stdout: | (launched: 2022-12-09_19:39:06.584294) 19:39:07.845048 run osmo-msc_10.42.42.6(pid=7799): stderr: | [0;m[38;5;43m20221209193906909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193906909 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5672d83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193906910 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193906910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193906910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193906910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193906912 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193906912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193906912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193906912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:07.897269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7792): Terminating (SIGTERM) 19:39:07.939014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7795): Terminating (SIGTERM) 19:39:07.980693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7798): Terminating (SIGTERM) 19:39:08.023279 --- ParallelTerminationStrategy: PID 7792 died... 19:39:08.043195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7792): Terminated: ok {rc=0} 19:39:08.090232 --- ParallelTerminationStrategy: PID 7795 died... 19:39:08.109929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7795): Terminated: ok {rc=0} 19:39:08.157080 --- ParallelTerminationStrategy: PID 7798 died... 19:39:08.176626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7798): Terminated: ok {rc=0} 19:39:08.263470 bus /sierra_3: Setting Powered False 19:39:09.362283 bus /sierra_3: Setting Powered False 19:39:10.477422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:39:11.714699 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:11.722082 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:39:11.746472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:39:11.773239 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:39:11.824764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:39:11.848418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:39:11.875495 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:39:12.426166 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:39:12.476203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:12.487539 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:39:12.547665 tst mo_mt_call.py: using LAC 23265 19:39:12.668639 tst mo_mt_call.py: using RAC 60 19:39:12.791313 tst mo_mt_call.py: using CellId 23265 19:39:12.913544 tst mo_mt_call.py: using BVCI 23266 19:39:13.024798 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:13.035926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:13.046891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:13.058829 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:13.070628 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:13.082072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:39:13.202868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:39:13.323980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:13.799164 run create_hlr_db(pid=7804): Launched 19:39:13.924378 bus /sierra_2: Setting Powered False 19:39:14.985837 run create_hlr_db(pid=7804): Terminated: ok {rc=0} 19:39:15.413958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7806): Launched 19:39:15.721851 run osmo-hlr_10.42.42.2(pid=7807): Launched 19:39:15.866437 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:16.572320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7809): Launched 19:39:16.900614 run osmo-stp_10.42.42.5(pid=7810): Launched 19:39:17.125655 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:17.859790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7812): Launched 19:39:18.189608 run osmo-msc_10.42.42.6(pid=7813): Launched 19:39:18.371163 run osmo-stp_10.42.42.5(pid=7810): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7810)] 19:39:18.508459 run osmo-stp_10.42.42.5(pid=7810): stdout: | (launched: 2022-12-09_19:39:16.842494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:18.646021 run osmo-stp_10.42.42.5(pid=7810): stderr: | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193917117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193917118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193917119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193917119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:18.783392 run osmo-stp_10.42.42.5(pid=7810): stdout: | (launched: 2022-12-09_19:39:16.842494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:18.914103 run osmo-stp_10.42.42.5(pid=7810): stderr: | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193917116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193917117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193917118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193917119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193917119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:19.070208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7810): Process ended prematurely: osmo-stp_10.42.42.5(pid=7810) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7810)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:39:19.080002 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 19:39:19.108255 run osmo-hlr_10.42.42.2(pid=7807): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7807)] 19:39:19.158250 run osmo-hlr_10.42.42.2(pid=7807): stdout: | (launched: 2022-12-09_19:39:15.664380) 19:39:19.209522 run osmo-hlr_10.42.42.2(pid=7807): stderr: | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193915848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193915873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193915894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193915894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193915894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:19.281081 run osmo-msc_10.42.42.6(pid=7813): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7813)] 19:39:19.330927 run osmo-msc_10.42.42.6(pid=7813): stdout: | (launched: 2022-12-09_19:39:18.129225) 19:39:19.382561 run osmo-msc_10.42.42.6(pid=7813): stderr: | [0;m[38;5;43m20221209193918454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193918454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b05504c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193918454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193918455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193918455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193918455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193918457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193918457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193918457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193918457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:19.434383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7806): Terminating (SIGTERM) 19:39:19.476244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7809): Terminating (SIGTERM) 19:39:19.517882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7812): Terminating (SIGTERM) 19:39:19.559558 --- ParallelTerminationStrategy: PID 7806 died... 19:39:19.579480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7806): Terminated: ok {rc=0} 19:39:19.625943 --- ParallelTerminationStrategy: PID 7809 died... 19:39:19.645387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7809): Terminated: ok {rc=0} 19:39:19.691425 --- ParallelTerminationStrategy: PID 7812 died... 19:39:19.710879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7812): Terminated: ok {rc=0} 19:39:19.798116 bus /sierra_3: Setting Powered False 19:39:20.895877 bus /sierra_3: Setting Powered False 19:39:22.011741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:39:23.155005 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.167058 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:39:23.227746 tst mo_mt_call_osmux.py: using LAC 23266 19:39:23.348177 tst mo_mt_call_osmux.py: using RAC 61 19:39:23.473546 tst mo_mt_call_osmux.py: using CellId 23266 19:39:23.602022 tst mo_mt_call_osmux.py: using BVCI 23267 19:39:23.713258 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.724549 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.735848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.747124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.758524 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:39:23.769720 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:39:23.891784 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:39:24.010676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:24.487148 run create_hlr_db(pid=7815): Launched 19:39:24.613713 bus /sierra_2: Setting Powered False 19:39:25.673940 run create_hlr_db(pid=7815): Terminated: ok {rc=0} 19:39:26.121937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7817): Launched 19:39:26.451795 run osmo-hlr_10.42.42.2(pid=7818): Launched 19:39:26.577789 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:27.143856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7820): Launched 19:39:27.473520 run osmo-stp_10.42.42.5(pid=7821): Launched 19:39:27.598651 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:28.196563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7823): Launched 19:39:28.525937 run osmo-msc_10.42.42.6(pid=7824): Launched 19:39:28.709626 run osmo-stp_10.42.42.5(pid=7821): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7821)] 19:39:28.848025 run osmo-stp_10.42.42.5(pid=7821): stdout: | (launched: 2022-12-09_19:39:27.412694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:28.987055 run osmo-stp_10.42.42.5(pid=7821): stderr: | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193927607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:29.124926 run osmo-stp_10.42.42.5(pid=7821): stdout: | (launched: 2022-12-09_19:39:27.412694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:29.255684 run osmo-stp_10.42.42.5(pid=7821): stderr: | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193927607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193927607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193927608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:29.412453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7821): Process ended prematurely: osmo-stp_10.42.42.5(pid=7821) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7821)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:39:29.422469 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:39:29.451213 run osmo-hlr_10.42.42.2(pid=7818): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7818)] 19:39:29.501441 run osmo-hlr_10.42.42.2(pid=7818): stdout: | (launched: 2022-12-09_19:39:26.390760) 19:39:29.553218 run osmo-hlr_10.42.42.2(pid=7818): stderr: | [0;m[1;31m20221209193926589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193926589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193926589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193926590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193926590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193926590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193926601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193926610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193926611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193926611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:29.624780 run osmo-msc_10.42.42.6(pid=7824): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7824)] 19:39:29.674564 run osmo-msc_10.42.42.6(pid=7824): stdout: | (launched: 2022-12-09_19:39:28.465024) 19:39:29.725738 run osmo-msc_10.42.42.6(pid=7824): stderr: | [0;m[38;5;43m20221209193928789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193928789 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8aa20c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193928789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193928789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193928789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193928790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193928791 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193928792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193928792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193928792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:29.777236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7817): Terminating (SIGTERM) 19:39:29.818661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7820): Terminating (SIGTERM) 19:39:29.859891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7823): Terminating (SIGTERM) 19:39:29.902228 --- ParallelTerminationStrategy: PID 7817 died... 19:39:29.922451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7817): Terminated: ok {rc=0} 19:39:29.968706 --- ParallelTerminationStrategy: PID 7820 died... 19:39:29.988184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7820): Terminated: ok {rc=0} 19:39:30.034119 --- ParallelTerminationStrategy: PID 7823 died... 19:39:30.053573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7823): Terminated: ok {rc=0} 19:39:30.140498 bus /sierra_3: Setting Powered False 19:39:31.235339 bus /sierra_3: Setting Powered False 19:39:32.362476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:39:33.604049 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:33.612410 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:39:33.638212 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:39:33.665641 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:39:33.719594 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:39:33.744385 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:39:33.771868 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:39:34.322821 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:39:34.375312 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:34.386974 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:39:34.447972 tst mo_mt_call.py: using LAC 23267 19:39:34.577161 tst mo_mt_call.py: using RAC 62 19:39:34.704801 tst mo_mt_call.py: using CellId 23267 19:39:34.833354 tst mo_mt_call.py: using BVCI 23268 19:39:34.952851 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:34.964530 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:34.976035 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:34.987668 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:34.999400 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:35.011186 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:35.132430 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:35.253852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:35.761472 run create_hlr_db(pid=7829): Launched 19:39:35.887100 bus /sierra_2: Setting Powered False 19:39:36.951489 run create_hlr_db(pid=7829): Terminated: ok {rc=0} 19:39:37.389705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7831): Launched 19:39:37.697254 run osmo-hlr_10.42.42.2(pid=7832): Launched 19:39:37.813841 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:38.342266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7834): Launched 19:39:38.649979 run osmo-stp_10.42.42.5(pid=7835): Launched 19:39:38.768611 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:39.356325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7837): Launched 19:39:39.686895 run osmo-msc_10.42.42.6(pid=7838): Launched 19:39:39.869604 run osmo-stp_10.42.42.5(pid=7835): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7835)] 19:39:40.009470 run osmo-stp_10.42.42.5(pid=7835): stdout: | (launched: 2022-12-09_19:39:38.592278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:40.148484 run osmo-stp_10.42.42.5(pid=7835): stderr: | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193938765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:40.286187 run osmo-stp_10.42.42.5(pid=7835): stdout: | (launched: 2022-12-09_19:39:38.592278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:40.416736 run osmo-stp_10.42.42.5(pid=7835): stderr: | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193938764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193938765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193938765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:40.573821 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7835): Process ended prematurely: osmo-stp_10.42.42.5(pid=7835) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7835)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:39:40.583591 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:39:40.612461 run osmo-hlr_10.42.42.2(pid=7832): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7832)] 19:39:40.662306 run osmo-hlr_10.42.42.2(pid=7832): stdout: | (launched: 2022-12-09_19:39:37.640294) 19:39:40.713516 run osmo-hlr_10.42.42.2(pid=7832): stderr: | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193937816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193937833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:40.785352 run osmo-msc_10.42.42.6(pid=7838): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7838)] 19:39:40.835255 run osmo-msc_10.42.42.6(pid=7838): stdout: | (launched: 2022-12-09_19:39:39.625786) 19:39:40.886468 run osmo-msc_10.42.42.6(pid=7838): stderr: | [0;m[38;5;43m20221209193939948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193939949 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b58cc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193939949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193939949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193939949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193939949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193939951 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193939951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193939951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193939951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:40.938000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7831): Terminating (SIGTERM) 19:39:40.979366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7834): Terminating (SIGTERM) 19:39:41.020615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7837): Terminating (SIGTERM) 19:39:41.062333 --- ParallelTerminationStrategy: PID 7831 died... 19:39:41.082191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7831): Terminated: ok {rc=0} 19:39:41.128306 --- ParallelTerminationStrategy: PID 7834 died... 19:39:41.147631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7834): Terminated: ok {rc=0} 19:39:41.193458 --- ParallelTerminationStrategy: PID 7837 died... 19:39:41.212755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7837): Terminated: ok {rc=0} 19:39:41.312871 bus /sierra_3: Setting Powered False 19:39:42.409154 bus /sierra_3: Setting Powered False 19:39:43.520901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:39:44.666244 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:44.678483 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:39:44.739580 tst mo_mt_call_osmux.py: using LAC 23268 19:39:44.864014 tst mo_mt_call_osmux.py: using RAC 63 19:39:44.989049 tst mo_mt_call_osmux.py: using CellId 23268 19:39:45.115192 tst mo_mt_call_osmux.py: using BVCI 23269 19:39:45.230775 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:45.242360 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:45.253725 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:45.265299 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:45.276733 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:45.288414 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:45.403460 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:45.517256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:46.022479 run create_hlr_db(pid=7840): Launched 19:39:46.154872 bus /sierra_2: Setting Powered False 19:39:47.218663 run create_hlr_db(pid=7840): Terminated: ok {rc=0} 19:39:47.650184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7842): Launched 19:39:47.949496 run osmo-hlr_10.42.42.2(pid=7843): Launched 19:39:48.062126 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:48.594202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7845): Launched 19:39:48.893681 run osmo-stp_10.42.42.5(pid=7846): Launched 19:39:49.006838 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:49.547772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7848): Launched 19:39:49.847334 run osmo-msc_10.42.42.6(pid=7849): Launched 19:39:50.013401 run osmo-stp_10.42.42.5(pid=7846): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7846)] 19:39:50.139157 run osmo-stp_10.42.42.5(pid=7846): stdout: | (launched: 2022-12-09_19:39:48.837880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:50.264917 run osmo-stp_10.42.42.5(pid=7846): stderr: | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193949003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:50.389591 run osmo-stp_10.42.42.5(pid=7846): stdout: | (launched: 2022-12-09_19:39:48.837880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:50.508892 run osmo-stp_10.42.42.5(pid=7846): stderr: | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193949003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:50.651417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7846): Process ended prematurely: osmo-stp_10.42.42.5(pid=7846) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7846)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:39:50.660370 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:39:50.686666 run osmo-hlr_10.42.42.2(pid=7843): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7843)] 19:39:50.733276 run osmo-hlr_10.42.42.2(pid=7843): stdout: | (launched: 2022-12-09_19:39:47.894048) 19:39:50.781602 run osmo-hlr_10.42.42.2(pid=7843): stderr: | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193948068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193948080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193948089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193948089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193948089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:50.849329 run osmo-msc_10.42.42.6(pid=7849): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7849)] 19:39:50.896194 run osmo-msc_10.42.42.6(pid=7849): stdout: | (launched: 2022-12-09_19:39:49.791447) 19:39:50.944440 run osmo-msc_10.42.42.6(pid=7849): stderr: | [0;m[38;5;43m20221209193950061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209193950061 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb14fcc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209193950061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209193950061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209193950061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209193950061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209193950063 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209193950064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209193950065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209193950065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:50.992611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7842): Terminating (SIGTERM) 19:39:51.031185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7845): Terminating (SIGTERM) 19:39:51.069658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7848): Terminating (SIGTERM) 19:39:51.108825 --- ParallelTerminationStrategy: PID 7842 died... 19:39:51.127734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7842): Terminated: ok {rc=0} 19:39:51.171400 --- ParallelTerminationStrategy: PID 7845 died... 19:39:51.189733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7845): Terminated: ok {rc=0} 19:39:51.233131 --- ParallelTerminationStrategy: PID 7848 died... 19:39:51.251445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7848): Terminated: ok {rc=0} 19:39:51.335306 bus /sierra_3: Setting Powered False 19:39:52.432476 bus /sierra_3: Setting Powered False 19:39:53.545788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:39:54.784087 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:54.792137 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:39:54.817631 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:39:54.844797 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:39:54.900542 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:39:54.925945 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:39:54.953829 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:39:55.502467 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:39:55.554540 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:55.566390 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:39:55.627732 tst mo_mt_call.py: using LAC 23269 19:39:55.752861 tst mo_mt_call.py: using RAC 64 19:39:55.877379 tst mo_mt_call.py: using CellId 23269 19:39:56.002086 tst mo_mt_call.py: using BVCI 23270 19:39:56.118084 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:56.129901 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:56.141314 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:56.152876 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:56.164604 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:56.176342 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:56.290672 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:56.408582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:56.904786 run create_hlr_db(pid=7854): Launched 19:39:57.026169 bus /sierra_2: Setting Powered False 19:39:58.089432 run create_hlr_db(pid=7854): Terminated: ok {rc=0} 19:39:58.516113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7856): Launched 19:39:58.815310 run osmo-hlr_10.42.42.2(pid=7857): Launched 19:39:58.928135 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:59.442869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7859): Launched 19:39:59.741450 run osmo-stp_10.42.42.5(pid=7860): Launched 19:39:59.854189 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:00.398618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7862): Launched 19:40:00.697627 run osmo-msc_10.42.42.6(pid=7863): Launched 19:40:00.895178 run osmo-stp_10.42.42.5(pid=7860): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7860)] 19:40:01.176197 run osmo-stp_10.42.42.5(pid=7860): stdout: | (launched: 2022-12-09_19:39:59.686048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:01.322253 run osmo-stp_10.42.42.5(pid=7860): stderr: | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193959855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:01.451449 run osmo-stp_10.42.42.5(pid=7860): stdout: | (launched: 2022-12-09_19:39:59.686048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:01.572732 run osmo-stp_10.42.42.5(pid=7860): stderr: | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209193959855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209193959855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209193959856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:01.729093 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7860): Process ended prematurely: osmo-stp_10.42.42.5(pid=7860) [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7860)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:40:01.739100 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:40:01.766129 run osmo-hlr_10.42.42.2(pid=7857): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7857)] 19:40:01.813385 run osmo-hlr_10.42.42.2(pid=7857): stdout: | (launched: 2022-12-09_19:39:58.760055) 19:40:01.862604 run osmo-hlr_10.42.42.2(pid=7857): stderr: | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209193958932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209193958944 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209193958953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209193958953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209193958953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:01.931713 run osmo-msc_10.42.42.6(pid=7863): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7863)] 19:40:01.979544 run osmo-msc_10.42.42.6(pid=7863): stdout: | (launched: 2022-12-09_19:40:00.642248) 19:40:02.028251 run osmo-msc_10.42.42.6(pid=7863): stderr: | [0;m[38;5;43m20221209194001006 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194001006 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd228edac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194001006 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194001006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194001006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194001006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194001008 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194001008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194001009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194001009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:02.078221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7856): Terminating (SIGTERM) 19:40:02.118389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7859): Terminating (SIGTERM) 19:40:02.159589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7862): Terminating (SIGTERM) 19:40:02.199596 --- ParallelTerminationStrategy: PID 7856 died... 19:40:02.218688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7856): Terminated: ok {rc=0} 19:40:02.262528 --- ParallelTerminationStrategy: PID 7859 died... 19:40:02.281352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7859): Terminated: ok {rc=0} 19:40:02.324605 --- ParallelTerminationStrategy: PID 7862 died... 19:40:02.343151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7862): Terminated: ok {rc=0} 19:40:02.427493 bus /sierra_3: Setting Powered False 19:40:03.528078 bus /sierra_3: Setting Powered False 19:40:04.648481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:40:05.791054 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:05.802871 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:40:05.861800 tst mo_mt_call_osmux.py: using LAC 23270 19:40:05.977279 tst mo_mt_call_osmux.py: using RAC 65 19:40:06.092531 tst mo_mt_call_osmux.py: using CellId 23270 19:40:06.217444 tst mo_mt_call_osmux.py: using BVCI 23271 19:40:06.334462 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:06.346245 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:06.357749 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:06.369783 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:06.381705 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:40:06.393533 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:40:06.510578 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:40:06.631996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:07.122587 run create_hlr_db(pid=7868): Launched 19:40:07.242846 bus /sierra_2: Setting Powered False 19:40:08.305620 run create_hlr_db(pid=7868): Terminated: ok {rc=0} 19:40:08.747338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7870): Launched 19:40:09.063745 run osmo-hlr_10.42.42.2(pid=7871): Launched 19:40:09.184189 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:09.732513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7873): Launched 19:40:10.049588 run osmo-stp_10.42.42.5(pid=7874): Launched 19:40:10.169850 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:10.742605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7876): Launched 19:40:11.060851 run osmo-msc_10.42.42.6(pid=7877): Launched 19:40:11.238344 run osmo-stp_10.42.42.5(pid=7874): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7874)] 19:40:11.373227 run osmo-stp_10.42.42.5(pid=7874): stdout: | (launched: 2022-12-09_19:40:09.991592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:11.508649 run osmo-stp_10.42.42.5(pid=7874): stderr: | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194010179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:11.641803 run osmo-stp_10.42.42.5(pid=7874): stdout: | (launched: 2022-12-09_19:40:09.991592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:11.769103 run osmo-stp_10.42.42.5(pid=7874): stderr: | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194010178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194010179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194010179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:11.921138 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7874): Process ended prematurely: osmo-stp_10.42.42.5(pid=7874) [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7874)] [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:40:11.930775 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:40:11.958546 run osmo-hlr_10.42.42.2(pid=7871): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7871)] 19:40:12.008377 run osmo-hlr_10.42.42.2(pid=7871): stdout: | (launched: 2022-12-09_19:40:09.005797) 19:40:12.059395 run osmo-hlr_10.42.42.2(pid=7871): stderr: | [0;m[1;31m20221209194009196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194009196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194009196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194009196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194009197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194009197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194009209 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194009218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194009218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194009218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:12.130267 run osmo-msc_10.42.42.6(pid=7877): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7877)] 19:40:12.179433 run osmo-msc_10.42.42.6(pid=7877): stdout: | (launched: 2022-12-09_19:40:11.002102) 19:40:12.241546 run osmo-msc_10.42.42.6(pid=7877): stderr: | [0;m[38;5;43m20221209194011317 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194011317 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95a8f59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194011317 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194011317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194011317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194011318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194011319 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194011320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194011320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194011320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:12.292836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7870): Terminating (SIGTERM) 19:40:12.333876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7873): Terminating (SIGTERM) 19:40:12.374847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7876): Terminating (SIGTERM) 19:40:12.416035 --- ParallelTerminationStrategy: PID 7870 died... 19:40:12.435657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7870): Terminated: ok {rc=0} 19:40:12.481717 --- ParallelTerminationStrategy: PID 7873 died... 19:40:12.501289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7873): Terminated: ok {rc=0} 19:40:12.547254 --- ParallelTerminationStrategy: PID 7876 died... 19:40:12.566462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7876): Terminated: ok {rc=0} 19:40:12.653260 bus /sierra_3: Setting Powered False 19:40:13.750075 bus /sierra_3: Setting Powered False 19:40:14.864137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:nanobts+band-1900 --------------------------------------------------------------------- 19:40:16.104553 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:16.112176 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:40:16.140785 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:40:16.169831 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 19:40:16.260753 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:40:16.297669 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:40:16.327989 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 19:40:16.900037 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 19:40:16.906293 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:16.922075 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:40:16.973363 tst emergency_mo_mt_call.py: using LAC 23271 19:40:17.125574 tst emergency_mo_mt_call.py: using RAC 66 19:40:17.257820 tst emergency_mo_mt_call.py: using CellId 23271 19:40:17.370618 tst emergency_mo_mt_call.py: using BVCI 23272 19:40:17.474042 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:17.484669 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:17.495232 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:17.505651 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:17.515895 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:17.526172 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:17.642593 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:17.761426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:18.239815 run create_hlr_db(pid=7882): Launched 19:40:18.359276 bus /sierra_2: Setting Powered False 19:40:19.421794 run create_hlr_db(pid=7882): Terminated: ok {rc=0} 19:40:19.841646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7884): Launched 19:40:20.133030 run osmo-hlr_10.42.42.2(pid=7885): Launched 19:40:20.243852 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:20.746832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7887): Launched 19:40:21.037271 run osmo-stp_10.42.42.5(pid=7888): Launched 19:40:21.157421 tst emergency_mo_mt_call.py: using MSISDN 7341 19:40:21.314127 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:21.839583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7890): Launched 19:40:22.131806 run osmo-msc_10.42.42.6(pid=7891): Launched 19:40:22.294733 run osmo-stp_10.42.42.5(pid=7888): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7888)] 19:40:22.417785 run osmo-stp_10.42.42.5(pid=7888): stdout: | (launched: 2022-12-09_19:40:20.983576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:22.548276 run osmo-stp_10.42.42.5(pid=7888): stderr: | [0;m[38;5;43m20221209194021150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194021151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194021151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194021151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:22.669590 run osmo-stp_10.42.42.5(pid=7888): stdout: | (launched: 2022-12-09_19:40:20.983576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:22.785964 run osmo-stp_10.42.42.5(pid=7888): stderr: | [0;m[38;5;43m20221209194021150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194021151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194021151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194021151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194021152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:22.925508 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7888): Process ended prematurely: osmo-stp_10.42.42.5(pid=7888) [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7888)] [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 19:40:22.933749 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 19:40:22.959327 run osmo-hlr_10.42.42.2(pid=7885): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7885)] 19:40:23.005799 run osmo-hlr_10.42.42.2(pid=7885): stdout: | (launched: 2022-12-09_19:40:20.079322) 19:40:23.054142 run osmo-hlr_10.42.42.2(pid=7885): stderr: | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194020250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194020263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194020274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194020274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194020274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:23.121607 run osmo-msc_10.42.42.6(pid=7891): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7891)] 19:40:23.168661 run osmo-msc_10.42.42.6(pid=7891): stdout: | (launched: 2022-12-09_19:40:22.077976) 19:40:23.216860 run osmo-msc_10.42.42.6(pid=7891): stderr: | [0;m[38;5;43m20221209194022348 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194022348 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac868bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194022348 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194022348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194022348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194022349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194022351 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194022351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194022351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194022351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:23.265302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7884): Terminating (SIGTERM) 19:40:23.303960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7887): Terminating (SIGTERM) 19:40:23.342559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7890): Terminating (SIGTERM) 19:40:23.381530 --- ParallelTerminationStrategy: PID 7884 died... 19:40:23.400164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7884): Terminated: ok {rc=0} 19:40:23.443443 --- ParallelTerminationStrategy: PID 7887 died... 19:40:23.461839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7887): Terminated: ok {rc=0} 19:40:23.504722 --- ParallelTerminationStrategy: PID 7890 died... 19:40:23.523143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7890): Terminated: ok {rc=0} 19:40:23.606529 bus /sierra_3: Setting Powered False 19:40:24.705224 bus /sierra_3: Setting Powered False 19:40:25.819347 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 19:40:26.907580 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:26.919473 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:40:26.961155 tst emergency_preemptive_call.py: using LAC 23272 19:40:27.084244 tst emergency_preemptive_call.py: using RAC 67 19:40:27.207957 tst emergency_preemptive_call.py: using CellId 23272 19:40:27.330476 tst emergency_preemptive_call.py: using BVCI 23273 19:40:27.444272 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:27.455463 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:27.466680 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:27.478164 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:27.490652 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:40:27.502635 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:27.616799 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:27.736379 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:27.853189 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:27.966037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:28.421808 run create_hlr_db(pid=7893): Launched 19:40:28.547211 bus /sierra_2: Setting Powered False 19:40:29.610343 run create_hlr_db(pid=7893): Terminated: ok {rc=0} 19:40:30.054565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7895): Launched 19:40:30.373100 run osmo-hlr_10.42.42.2(pid=7896): Launched 19:40:30.494775 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:31.062387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7898): Launched 19:40:31.382959 run osmo-stp_10.42.42.5(pid=7899): Launched 19:40:31.547993 tst emergency_preemptive_call.py: using MSISDN 7342 19:40:31.869962 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:32.422563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7901): Launched 19:40:32.720527 run osmo-msc_10.42.42.6(pid=7902): Launched 19:40:32.886278 run osmo-stp_10.42.42.5(pid=7899): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7899)] 19:40:33.011155 run osmo-stp_10.42.42.5(pid=7899): stdout: | (launched: 2022-12-09_19:40:31.326313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:33.135863 run osmo-stp_10.42.42.5(pid=7899): stderr: | [0;m[38;5;43m20221209194031604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194031605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194031605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194031605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:33.260635 run osmo-stp_10.42.42.5(pid=7899): stdout: | (launched: 2022-12-09_19:40:31.326313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:33.379068 run osmo-stp_10.42.42.5(pid=7899): stderr: | [0;m[38;5;43m20221209194031604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194031605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194031605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194031605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194031606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:33.521321 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7899): Process ended prematurely: osmo-stp_10.42.42.5(pid=7899) [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7899)] [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 19:40:33.529791 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 19:40:33.555887 run osmo-hlr_10.42.42.2(pid=7896): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7896)] 19:40:33.603050 run osmo-hlr_10.42.42.2(pid=7896): stdout: | (launched: 2022-12-09_19:40:30.314930) 19:40:33.651987 run osmo-hlr_10.42.42.2(pid=7896): stderr: | [0;m[1;31m20221209194030506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194030506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194030506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194030507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194030507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194030507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194030521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194030529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194030530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194030530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:33.720270 run osmo-msc_10.42.42.6(pid=7902): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7902)] 19:40:33.767490 run osmo-msc_10.42.42.6(pid=7902): stdout: | (launched: 2022-12-09_19:40:32.665765) 19:40:33.816126 run osmo-msc_10.42.42.6(pid=7902): stderr: | [0;m[38;5;43m20221209194032934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194032934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e5e981c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194032934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194032934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194032935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194032935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194032937 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194032938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194032938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194032938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:33.865265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7895): Terminating (SIGTERM) 19:40:33.904458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7898): Terminating (SIGTERM) 19:40:33.943891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7901): Terminating (SIGTERM) 19:40:33.983276 --- ParallelTerminationStrategy: PID 7895 died... 19:40:34.002143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7895): Terminated: ok {rc=0} 19:40:34.045742 --- ParallelTerminationStrategy: PID 7898 died... 19:40:34.064241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7898): Terminated: ok {rc=0} 19:40:34.107386 --- ParallelTerminationStrategy: PID 7901 died... 19:40:34.126022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7901): Terminated: ok {rc=0} 19:40:34.211186 bus /sierra_9: Setting Powered False 19:40:35.310544 bus /sierra_9: Setting Powered False 19:40:36.424362 bus /sierra_8: Setting Powered False 19:40:37.522980 bus /sierra_8: Setting Powered False 19:40:38.636270 bus /sierra_3: Setting Powered False 19:40:39.736376 bus /sierra_3: Setting Powered False 19:40:40.852931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900 --------------------------------------------------------------------- 19:40:42.124041 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:42.129095 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:40:42.152361 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 19:40:42.189853 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 19:40:42.274226 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:40:42.297358 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 19:40:42.334805 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 19:40:42.925854 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 19:40:42.974947 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:42.985565 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:40:43.023842 tst cs_paging_gprs_active.py: using LAC 23273 19:40:43.144213 tst cs_paging_gprs_active.py: using RAC 68 19:40:43.264843 tst cs_paging_gprs_active.py: using CellId 23273 19:40:43.385429 tst cs_paging_gprs_active.py: using BVCI 23274 19:40:43.494713 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.505379 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.515784 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.526258 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.536612 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.546952 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.557432 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.567669 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:43.578302 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:43.696170 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:43.815420 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:40:44.036422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:44.363709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Launched 19:40:44.646233 run iperf3-srv_10.42.42.10(pid=7908): Launched 19:40:44.769461 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:40:44.989143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:45.315240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Launched 19:40:45.599606 run iperf3-srv_10.42.42.10(pid=7910): Launched 19:40:45.721224 tst cs_paging_gprs_active.py:38: start network... 19:40:45.967050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:46.478657 run create_hlr_db(pid=7911): Launched 19:40:46.641772 bus /sierra_2: Setting Powered False 19:40:47.702845 run create_hlr_db(pid=7911): Terminated: ok {rc=0} 19:40:48.159027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Launched 19:40:48.484475 run osmo-hlr_10.42.42.2(pid=7914): Launched 19:40:48.609294 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:49.166688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Launched 19:40:49.492296 run osmo-stp_10.42.42.5(pid=7917): Launched 19:40:49.616334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:40:50.177664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Launched 19:40:50.302993 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:40:50.578128 run patchelf(pid=7920): Launched 19:40:50.758129 run osmo-stp_10.42.42.5(pid=7917): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] 19:40:50.895499 run osmo-stp_10.42.42.5(pid=7917): stdout: | (launched: 2022-12-09_19:40:49.433310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:51.034421 run osmo-stp_10.42.42.5(pid=7917): stderr: | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194049621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:51.172928 run osmo-stp_10.42.42.5(pid=7917): stdout: | (launched: 2022-12-09_19:40:49.433310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:51.305926 run osmo-stp_10.42.42.5(pid=7917): stderr: | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194049620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194049621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194049621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:51.464017 run patchelf(pid=7920): Terminating (SIGINT) 19:40:51.646199 run patchelf(pid=7920): Terminated: ok {rc=0} 19:40:51.777321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7917): Process ended prematurely: osmo-stp_10.42.42.5(pid=7917) [trial-2363↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] [trial-2363↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 19:40:51.787484 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:40:51.816067 run osmo-hlr_10.42.42.2(pid=7914): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7914)] 19:40:51.865402 run osmo-hlr_10.42.42.2(pid=7914): stdout: | (launched: 2022-12-09_19:40:48.425290) 19:40:51.916352 run osmo-hlr_10.42.42.2(pid=7914): stderr: | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194048620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194048637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:51.967808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Terminating (SIGTERM) 19:40:52.009129 run iperf3-srv_10.42.42.10(pid=7908): Terminating (SIGTERM) 19:40:52.050290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Terminating (SIGTERM) 19:40:52.091418 run iperf3-srv_10.42.42.10(pid=7910): Terminating (SIGTERM) 19:40:52.132539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Terminating (SIGTERM) 19:40:52.173849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Terminating (SIGTERM) 19:40:52.214999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Terminating (SIGTERM) 19:40:52.256267 --- ParallelTerminationStrategy: PID 7907 died... 19:40:52.275980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7907): Terminated: ok {rc=0} 19:40:52.322108 --- ParallelTerminationStrategy: PID 7908 died... 19:40:52.341428 run iperf3-srv_10.42.42.10(pid=7908): Terminated {rc=256} 19:40:52.386993 --- ParallelTerminationStrategy: PID 7909 died... 19:40:52.406238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7909): Terminated: ok {rc=0} 19:40:52.451790 --- ParallelTerminationStrategy: PID 7910 died... 19:40:52.471042 run iperf3-srv_10.42.42.10(pid=7910): Terminated {rc=256} 19:40:52.516803 --- ParallelTerminationStrategy: PID 7913 died... 19:40:52.536088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Terminated: ok {rc=0} 19:40:52.581759 --- ParallelTerminationStrategy: PID 7916 died... 19:40:52.600937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Terminated: ok {rc=0} 19:40:52.646531 --- ParallelTerminationStrategy: PID 7919 died... 19:40:52.665746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Terminated: ok {rc=0} 19:40:52.752010 bus /gobi_0: Setting Powered False 19:40:53.850204 bus /gobi_0: Setting Powered False 19:40:54.964828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 19:40:56.109456 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.120653 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:40:56.159001 tst iperf3.py: using LAC 23274 19:40:56.280425 tst iperf3.py: using RAC 69 19:40:56.413324 tst iperf3.py: using CellId 23274 19:40:56.533588 tst iperf3.py: using BVCI 23275 19:40:56.645562 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.656274 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.666979 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.677577 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.688053 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.698550 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.709207 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.719513 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:40:56.730193 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:40:56.851469 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:40:57.054835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:57.357421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Launched 19:40:57.620157 run iperf3-srv_10.42.42.10(pid=7922): Launched 19:40:57.732719 tst iperf3.py:8: start network... 19:40:57.935755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:58.403396 run create_hlr_db(pid=7923): Launched 19:40:58.526762 bus /gobi_6: Setting Powered False 19:40:59.586490 run create_hlr_db(pid=7923): Terminated: ok {rc=0} 19:41:00.029687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Launched 19:41:00.355901 run osmo-hlr_10.42.42.2(pid=7926): Launched 19:41:00.479237 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:01.064056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Launched 19:41:01.394939 run osmo-stp_10.42.42.5(pid=7929): Launched 19:41:01.639093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:02.249514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Launched 19:41:02.365898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:02.622001 run patchelf(pid=7932): Launched 19:41:02.791340 run osmo-stp_10.42.42.5(pid=7929): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] 19:41:02.919389 run osmo-stp_10.42.42.5(pid=7929): stdout: | (launched: 2022-12-09_19:41:01.333802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:03.049257 run osmo-stp_10.42.42.5(pid=7929): stderr: | [0;m[38;5;43m20221209194101625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194101625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194101626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194101626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194101626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194101627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194101627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:03.178960 run osmo-stp_10.42.42.5(pid=7929): stdout: | (launched: 2022-12-09_19:41:01.333802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:03.302813 run osmo-stp_10.42.42.5(pid=7929): stderr: | [0;m[38;5;43m20221209194101625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194101625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194101626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194101626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194101626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194101627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194101627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:03.449455 run patchelf(pid=7932): Terminating (SIGINT) 19:41:03.619551 run patchelf(pid=7932): Terminated: ok {rc=0} 19:41:03.741828 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7929): Process ended prematurely: osmo-stp_10.42.42.5(pid=7929) [trial-2363↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] [trial-2363↪gprs:nanobts+band-1900↪iperf3.py:8] 19:41:03.751284 tst iperf3.py:8: Test FAILED (7.7 sec) 19:41:03.778183 run osmo-hlr_10.42.42.2(pid=7926): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7926)] 19:41:03.824838 run osmo-hlr_10.42.42.2(pid=7926): stdout: | (launched: 2022-12-09_19:41:00.296843) 19:41:03.873242 run osmo-hlr_10.42.42.2(pid=7926): stderr: | [0;m[1;31m20221209194100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194100490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194100490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194100490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194100490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194100502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194100510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194100511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194100511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:03.921961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Terminating (SIGTERM) 19:41:03.961071 run iperf3-srv_10.42.42.10(pid=7922): Terminating (SIGTERM) 19:41:03.999959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Terminating (SIGTERM) 19:41:04.038973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Terminating (SIGTERM) 19:41:04.077924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Terminating (SIGTERM) 19:41:04.117258 --- ParallelTerminationStrategy: PID 7921 died... 19:41:04.135953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Terminated: ok {rc=0} 19:41:04.179515 --- ParallelTerminationStrategy: PID 7922 died... 19:41:04.197994 run iperf3-srv_10.42.42.10(pid=7922): Terminated {rc=256} 19:41:04.241176 --- ParallelTerminationStrategy: PID 7925 died... 19:41:04.259494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7925): Terminated: ok {rc=0} 19:41:04.302598 --- ParallelTerminationStrategy: PID 7928 died... 19:41:04.321079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7928): Terminated: ok {rc=0} 19:41:04.364823 --- ParallelTerminationStrategy: PID 7931 died... 19:41:04.383637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7931): Terminated: ok {rc=0} 19:41:04.469440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 19:41:05.620567 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:05.632452 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:41:05.672813 tst iperf3m4.py: using LAC 23275 19:41:05.801050 tst iperf3m4.py: using RAC 70 19:41:05.927426 tst iperf3m4.py: using CellId 23275 19:41:06.053612 tst iperf3m4.py: using BVCI 23276 19:41:06.171063 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.182257 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.193291 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.204496 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.215697 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.226839 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.238165 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.249552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:06.261055 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:06.377498 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:06.494965 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:06.612328 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:06.725913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:41:06.928605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:07.233163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7933): Launched 19:41:07.495537 run iperf3-srv_10.42.42.10(pid=7934): Launched 19:41:07.610684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:41:07.813742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:08.117809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7935): Launched 19:41:08.381574 run iperf3-srv_10.42.42.10(pid=7936): Launched 19:41:08.494742 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:41:08.697538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:09.001792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7937): Launched 19:41:09.264436 run iperf3-srv_10.42.42.10(pid=7938): Launched 19:41:09.377096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:41:09.581185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:09.885174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7939): Launched 19:41:10.147936 run iperf3-srv_10.42.42.10(pid=7940): Launched 19:41:10.261172 tst iperf3m4.py:8: start network... 19:41:10.464242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:10.933488 run create_hlr_db(pid=7941): Launched 19:41:11.058525 bus /gobi_6: Setting Powered False 19:41:12.122679 run create_hlr_db(pid=7941): Terminated: ok {rc=0} 19:41:12.574745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Launched 19:41:12.901502 run osmo-hlr_10.42.42.2(pid=7944): Launched 19:41:13.026220 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:13.590891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Launched 19:41:13.918866 run osmo-stp_10.42.42.5(pid=7947): Launched 19:41:14.043513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:14.611163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Launched 19:41:14.737991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:15.016052 run patchelf(pid=7950): Launched 19:41:15.202208 run osmo-stp_10.42.42.5(pid=7947): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] 19:41:15.340891 run osmo-stp_10.42.42.5(pid=7947): stdout: | (launched: 2022-12-09_19:41:13.858789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:15.481213 run osmo-stp_10.42.42.5(pid=7947): stderr: | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194114047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:15.622552 run osmo-stp_10.42.42.5(pid=7947): stdout: | (launched: 2022-12-09_19:41:13.858789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:15.756715 run osmo-stp_10.42.42.5(pid=7947): stderr: | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194114046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194114047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194114047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:15.919038 run patchelf(pid=7950): Terminating (SIGINT) 19:41:16.106293 run patchelf(pid=7950): Terminated: ok {rc=0} 19:41:16.241513 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7947): Process ended prematurely: osmo-stp_10.42.42.5(pid=7947) [trial-2363↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] [trial-2363↪gprs:nanobts+band-1900↪iperf3m4.py:8] 19:41:16.252561 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:41:16.282937 run osmo-hlr_10.42.42.2(pid=7944): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7944)] 19:41:16.333789 run osmo-hlr_10.42.42.2(pid=7944): stdout: | (launched: 2022-12-09_19:41:12.842133) 19:41:16.386215 run osmo-hlr_10.42.42.2(pid=7944): stderr: | [0;m[1;31m20221209194113033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194113034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194113034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194113034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194113034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194113034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194113046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194113054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194113054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194113055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:16.439080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7933): Terminating (SIGTERM) 19:41:16.482368 run iperf3-srv_10.42.42.10(pid=7934): Terminating (SIGTERM) 19:41:16.527867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7935): Terminating (SIGTERM) 19:41:16.571337 run iperf3-srv_10.42.42.10(pid=7936): Terminating (SIGTERM) 19:41:16.616814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7937): Terminating (SIGTERM) 19:41:16.660378 run iperf3-srv_10.42.42.10(pid=7938): Terminating (SIGTERM) 19:41:16.706230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7939): Terminating (SIGTERM) 19:41:16.749796 run iperf3-srv_10.42.42.10(pid=7940): Terminating (SIGTERM) 19:41:16.795195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Terminating (SIGTERM) 19:41:16.838293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Terminating (SIGTERM) 19:41:16.880677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Terminating (SIGTERM) 19:41:16.923595 --- ParallelTerminationStrategy: PID 7933 died... 19:41:16.943889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7933): Terminated: ok {rc=0} 19:41:16.991678 --- ParallelTerminationStrategy: PID 7934 died... 19:41:17.011826 run iperf3-srv_10.42.42.10(pid=7934): Terminated {rc=256} 19:41:17.059676 --- ParallelTerminationStrategy: PID 7935 died... 19:41:17.079836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7935): Terminated: ok {rc=0} 19:41:17.127802 --- ParallelTerminationStrategy: PID 7936 died... 19:41:17.147996 run iperf3-srv_10.42.42.10(pid=7936): Terminated {rc=256} 19:41:17.195500 --- ParallelTerminationStrategy: PID 7937 died... 19:41:17.215455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7937): Terminated: ok {rc=0} 19:41:17.262893 --- ParallelTerminationStrategy: PID 7938 died... 19:41:17.282871 run iperf3-srv_10.42.42.10(pid=7938): Terminated {rc=256} 19:41:17.330133 --- ParallelTerminationStrategy: PID 7939 died... 19:41:17.350137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7939): Terminated: ok {rc=0} 19:41:17.397326 --- ParallelTerminationStrategy: PID 7940 died... 19:41:17.417358 run iperf3-srv_10.42.42.10(pid=7940): Terminated {rc=256} 19:41:17.465251 --- ParallelTerminationStrategy: PID 7943 died... 19:41:17.484638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Terminated: ok {rc=0} 19:41:17.531360 --- ParallelTerminationStrategy: PID 7946 died... 19:41:17.551025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Terminated: ok {rc=0} 19:41:17.597420 --- ParallelTerminationStrategy: PID 7949 died... 19:41:17.617091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Terminated: ok {rc=0} 19:41:17.704314 bus /gobi_4: Setting Powered False 19:41:18.800337 bus /gobi_4: Setting Powered False 19:41:19.915089 bus /gobi_1: Setting Powered False 19:41:21.014454 bus /gobi_1: Setting Powered False 19:41:22.129882 bus /gobi_0: Setting Powered False 19:41:23.227490 bus /gobi_0: Setting Powered False 19:41:24.342863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 19:41:25.444162 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:25.455452 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:41:25.494284 tst ping.py: using LAC 23276 19:41:25.614060 tst ping.py: using RAC 71 19:41:25.734943 tst ping.py: using CellId 23276 19:41:25.853884 tst ping.py: using BVCI 23277 19:41:25.962231 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:25.972927 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:25.983530 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:25.994093 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:26.004432 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:26.014936 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:26.025529 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:26.035973 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:26.150408 tst ping.py:19: start network... 19:41:26.352834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:26.819525 run create_hlr_db(pid=7951): Launched 19:41:26.942445 bus /gobi_6: Setting Powered False 19:41:28.002308 run create_hlr_db(pid=7951): Terminated: ok {rc=0} 19:41:28.441992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Launched 19:41:28.768585 run osmo-hlr_10.42.42.2(pid=7954): Launched 19:41:28.892995 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:29.454509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Launched 19:41:29.780133 run osmo-stp_10.42.42.5(pid=7957): Launched 19:41:29.904602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:30.465720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Launched 19:41:30.580810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:30.840141 run patchelf(pid=7960): Launched 19:41:31.045293 run osmo-stp_10.42.42.5(pid=7957): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] 19:41:31.188058 run osmo-stp_10.42.42.5(pid=7957): stdout: | (launched: 2022-12-09_19:41:29.720806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:31.356126 run osmo-stp_10.42.42.5(pid=7957): stderr: | [0;m[38;5;43m20221209194129911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194129911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194129912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194129912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:31.519751 run osmo-stp_10.42.42.5(pid=7957): stdout: | (launched: 2022-12-09_19:41:29.720806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:31.658410 run osmo-stp_10.42.42.5(pid=7957): stderr: | [0;m[38;5;43m20221209194129911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194129911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194129912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194129912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194129913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:31.823928 run patchelf(pid=7960): Terminating (SIGINT) 19:41:32.011235 run patchelf(pid=7960): Terminated: ok {rc=0} 19:41:32.146135 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7957): Process ended prematurely: osmo-stp_10.42.42.5(pid=7957) [trial-2363↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] [trial-2363↪gprs:nanobts+band-1900↪ping.py:22] 19:41:32.157102 tst ping.py:22: Test FAILED (6.7 sec) 19:41:32.188942 run osmo-hlr_10.42.42.2(pid=7954): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7954)] 19:41:32.241960 run osmo-hlr_10.42.42.2(pid=7954): stdout: | (launched: 2022-12-09_19:41:28.709412) 19:41:32.295268 run osmo-hlr_10.42.42.2(pid=7954): stderr: | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194128907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194128921 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194128931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194128931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194128931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:32.348236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Terminating (SIGTERM) 19:41:32.390827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Terminating (SIGTERM) 19:41:32.433639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Terminating (SIGTERM) 19:41:32.476424 --- ParallelTerminationStrategy: PID 7953 died... 19:41:32.496577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Terminated: ok {rc=0} 19:41:32.544904 --- ParallelTerminationStrategy: PID 7956 died... 19:41:32.564879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Terminated: ok {rc=0} 19:41:32.612318 --- ParallelTerminationStrategy: PID 7959 died... 19:41:32.631879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Terminated: ok {rc=0} 19:41:32.719639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 19:41:33.806662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:33.818813 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:41:33.865725 tst ping_idle_ping.py: using LAC 23277 19:41:33.992515 tst ping_idle_ping.py: using RAC 72 19:41:34.118423 tst ping_idle_ping.py: using CellId 23277 19:41:34.242985 tst ping_idle_ping.py: using BVCI 23278 19:41:34.359709 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.370907 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.381934 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.393203 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.404300 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.415400 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.426717 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:41:34.438236 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:34.553678 tst ping_idle_ping.py:24: start network... 19:41:34.756490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:35.229313 run create_hlr_db(pid=7961): Launched 19:41:35.352528 bus /gobi_6: Setting Powered False 19:41:36.413630 run create_hlr_db(pid=7961): Terminated: ok {rc=0} 19:41:36.857240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7963): Launched 19:41:37.181358 run osmo-hlr_10.42.42.2(pid=7964): Launched 19:41:37.306607 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:37.870675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7966): Launched 19:41:38.196537 run osmo-stp_10.42.42.5(pid=7967): Launched 19:41:38.321699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:38.881861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7969): Launched 19:41:39.005279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:39.279498 run patchelf(pid=7970): Launched 19:41:39.461742 run osmo-stp_10.42.42.5(pid=7967): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7967)] 19:41:39.599615 run osmo-stp_10.42.42.5(pid=7967): stdout: | (launched: 2022-12-09_19:41:38.136763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:39.738537 run osmo-stp_10.42.42.5(pid=7967): stderr: | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194138329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:39.877616 run osmo-stp_10.42.42.5(pid=7967): stdout: | (launched: 2022-12-09_19:41:38.136763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:40.010984 run osmo-stp_10.42.42.5(pid=7967): stderr: | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194138328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194138329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194138329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:40.168430 run patchelf(pid=7970): Terminating (SIGINT) 19:41:40.349609 run patchelf(pid=7970): Terminated: ok {rc=0} 19:41:40.479876 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7967): Process ended prematurely: osmo-stp_10.42.42.5(pid=7967) [trial-2363↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7967)] [trial-2363↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 19:41:40.489792 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:41:40.518503 run osmo-hlr_10.42.42.2(pid=7964): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7964)] 19:41:40.568791 run osmo-hlr_10.42.42.2(pid=7964): stdout: | (launched: 2022-12-09_19:41:37.121976) 19:41:40.620878 run osmo-hlr_10.42.42.2(pid=7964): stderr: | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194137318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194137332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194137342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194137342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194137342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:40.672715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7963): Terminating (SIGTERM) 19:41:40.714358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7966): Terminating (SIGTERM) 19:41:40.756018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7969): Terminating (SIGTERM) 19:41:40.798123 --- ParallelTerminationStrategy: PID 7963 died... 19:41:40.818085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7963): Terminated: ok {rc=0} 19:41:40.864652 --- ParallelTerminationStrategy: PID 7966 died... 19:41:40.884319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7966): Terminated: ok {rc=0} 19:41:40.930387 --- ParallelTerminationStrategy: PID 7969 died... 19:41:40.949945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7969): Terminated: ok {rc=0} 19:41:41.037837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 19:41:42.340500 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:41:42.347364 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:41:42.373116 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:41:42.412520 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:41:42.501592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:41:42.525818 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:41:42.565557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:41:43.161528 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:41:43.214879 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.226406 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:41:43.267561 tst cs_paging_gprs_active.py: using LAC 23278 19:41:43.397083 tst cs_paging_gprs_active.py: using RAC 73 19:41:43.525225 tst cs_paging_gprs_active.py: using CellId 23278 19:41:43.656095 tst cs_paging_gprs_active.py: using BVCI 23279 19:41:43.775157 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.786634 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.797827 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.809289 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.820601 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.832444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.843922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.855290 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:43.867320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:43.983622 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:44.100918 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:41:44.308362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:44.618794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Launched 19:41:44.886990 run iperf3-srv_10.42.42.10(pid=7975): Launched 19:41:45.001901 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:41:45.208849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:45.517612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Launched 19:41:45.784399 run iperf3-srv_10.42.42.10(pid=7977): Launched 19:41:45.938215 tst cs_paging_gprs_active.py:38: start network... 19:41:46.186607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:46.710678 run create_hlr_db(pid=7978): Launched 19:41:46.874141 bus /gobi_6: Setting Powered False 19:41:47.939081 run create_hlr_db(pid=7978): Terminated: ok {rc=0} 19:41:48.395768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7980): Launched 19:41:48.726226 run osmo-hlr_10.42.42.2(pid=7981): Launched 19:41:48.850612 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:49.417989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7983): Launched 19:41:49.746646 run osmo-stp_10.42.42.5(pid=7984): Launched 19:41:49.872668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:50.439395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7986): Launched 19:41:50.566810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:50.845396 run patchelf(pid=7987): Launched 19:41:51.027931 run osmo-stp_10.42.42.5(pid=7984): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7984)] 19:41:51.167202 run osmo-stp_10.42.42.5(pid=7984): stdout: | (launched: 2022-12-09_19:41:49.686788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:51.307836 run osmo-stp_10.42.42.5(pid=7984): stderr: | [0;m[38;5;43m20221209194149877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194149877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194149878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194149878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194149878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194149879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194149879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:51.448169 run osmo-stp_10.42.42.5(pid=7984): stdout: | (launched: 2022-12-09_19:41:49.686788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:51.583448 run osmo-stp_10.42.42.5(pid=7984): stderr: | [0;m[38;5;43m20221209194149877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194149877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194149878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194149878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194149878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194149879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194149879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:51.743342 run patchelf(pid=7987): Terminating (SIGINT) 19:41:51.927169 run patchelf(pid=7987): Terminated: ok {rc=0} 19:41:52.060020 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7984): Process ended prematurely: osmo-stp_10.42.42.5(pid=7984) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7984)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:41:52.070884 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:41:52.100026 run osmo-hlr_10.42.42.2(pid=7981): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7981)] 19:41:52.149692 run osmo-hlr_10.42.42.2(pid=7981): stdout: | (launched: 2022-12-09_19:41:48.665977) 19:41:52.201197 run osmo-hlr_10.42.42.2(pid=7981): stderr: | [0;m[1;31m20221209194148862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194148863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194148863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194148863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194148863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194148863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194148876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194148884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194148884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194148884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:52.253271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Terminating (SIGTERM) 19:41:52.295149 run iperf3-srv_10.42.42.10(pid=7975): Terminating (SIGTERM) 19:41:52.336787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Terminating (SIGTERM) 19:41:52.378802 run iperf3-srv_10.42.42.10(pid=7977): Terminating (SIGTERM) 19:41:52.420365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7980): Terminating (SIGTERM) 19:41:52.462052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7983): Terminating (SIGTERM) 19:41:52.503823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7986): Terminating (SIGTERM) 19:41:52.546266 --- ParallelTerminationStrategy: PID 7974 died... 19:41:52.566275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7974): Terminated: ok {rc=0} 19:41:52.613097 --- ParallelTerminationStrategy: PID 7975 died... 19:41:52.632690 run iperf3-srv_10.42.42.10(pid=7975): Terminated {rc=256} 19:41:52.678631 --- ParallelTerminationStrategy: PID 7976 died... 19:41:52.698200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7976): Terminated: ok {rc=0} 19:41:52.744217 --- ParallelTerminationStrategy: PID 7977 died... 19:41:52.763485 run iperf3-srv_10.42.42.10(pid=7977): Terminated {rc=256} 19:41:52.809585 --- ParallelTerminationStrategy: PID 7980 died... 19:41:52.829132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7980): Terminated: ok {rc=0} 19:41:52.875322 --- ParallelTerminationStrategy: PID 7983 died... 19:41:52.894722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7983): Terminated: ok {rc=0} 19:41:52.941203 --- ParallelTerminationStrategy: PID 7986 died... 19:41:52.960577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7986): Terminated: ok {rc=0} 19:41:53.047627 bus /gobi_0: Setting Powered False 19:41:54.146409 bus /gobi_0: Setting Powered False 19:41:55.261522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:41:56.411036 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:56.423286 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:41:56.467470 tst iperf3.py: using LAC 23279 19:41:56.598056 tst iperf3.py: using RAC 74 19:41:56.726660 tst iperf3.py: using CellId 23279 19:41:56.853992 tst iperf3.py: using BVCI 23280 19:41:56.973243 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:56.984688 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:56.996154 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.007623 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.018936 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.030203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.041759 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.053130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:57.064805 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:57.185343 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:41:57.408729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:57.740434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Launched 19:41:58.028720 run iperf3-srv_10.42.42.10(pid=7989): Launched 19:41:58.151996 tst iperf3.py:8: start network... 19:41:58.374881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:58.885531 run create_hlr_db(pid=7990): Launched 19:41:59.012306 bus /gobi_6: Setting Powered False 19:42:00.077592 run create_hlr_db(pid=7990): Terminated: ok {rc=0} 19:42:00.517583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Launched 19:42:00.825736 run osmo-hlr_10.42.42.2(pid=7993): Launched 19:42:01.175109 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:01.760355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Launched 19:42:02.110206 run osmo-stp_10.42.42.5(pid=8006): Launched 19:42:02.238188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:02.797950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Launched 19:42:02.915147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:03.175975 run patchelf(pid=8009): Launched 19:42:03.346592 run osmo-stp_10.42.42.5(pid=8006): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] 19:42:03.476574 run osmo-stp_10.42.42.5(pid=8006): stdout: | (launched: 2022-12-09_19:42:02.048420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:03.608114 run osmo-stp_10.42.42.5(pid=8006): stderr: | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194202346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:03.739943 run osmo-stp_10.42.42.5(pid=8006): stdout: | (launched: 2022-12-09_19:42:02.048420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:03.866109 run osmo-stp_10.42.42.5(pid=8006): stderr: | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194202345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194202346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194202346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:04.015931 run patchelf(pid=8009): Terminating (SIGINT) 19:42:04.188028 run patchelf(pid=8009): Terminated: ok {rc=0} 19:42:04.311723 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8006): Process ended prematurely: osmo-stp_10.42.42.5(pid=8006) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 19:42:04.321367 tst iperf3.py:8: Test FAILED (8.0 sec) 19:42:04.348692 run osmo-hlr_10.42.42.2(pid=7993): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7993)] 19:42:04.395663 run osmo-hlr_10.42.42.2(pid=7993): stdout: | (launched: 2022-12-09_19:42:00.769096) 19:42:04.443990 run osmo-hlr_10.42.42.2(pid=7993): stderr: | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194200959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194200973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194200981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194200982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194200982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:04.492782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminating (SIGTERM) 19:42:04.531783 run iperf3-srv_10.42.42.10(pid=7989): Terminating (SIGTERM) 19:42:04.572036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminating (SIGTERM) 19:42:04.611996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Terminating (SIGTERM) 19:42:04.651023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Terminating (SIGTERM) 19:42:04.690290 --- ParallelTerminationStrategy: PID 7988 died... 19:42:04.708996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminated: ok {rc=0} 19:42:04.752078 --- ParallelTerminationStrategy: PID 7989 died... 19:42:04.770362 run iperf3-srv_10.42.42.10(pid=7989): Terminated {rc=256} 19:42:04.813811 --- ParallelTerminationStrategy: PID 7992 died... 19:42:04.831956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminated: ok {rc=0} 19:42:04.875753 --- ParallelTerminationStrategy: PID 8005 died... 19:42:04.894086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Terminated: ok {rc=0} 19:42:04.936884 --- ParallelTerminationStrategy: PID 8008 died... 19:42:04.955606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Terminated: ok {rc=0} 19:42:05.040173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:42:06.188628 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.200165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:42:06.240535 tst iperf3m4.py: using LAC 23280 19:42:06.362258 tst iperf3m4.py: using RAC 75 19:42:06.482369 tst iperf3m4.py: using CellId 23280 19:42:06.604509 tst iperf3m4.py: using BVCI 23281 19:42:06.716908 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.727966 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.738719 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.749417 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.759968 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.770622 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.781523 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.792048 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.802818 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:06.919291 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:07.042384 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:07.161109 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:07.279956 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:07.491254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:07.823197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8010): Launched 19:42:08.110578 run iperf3-srv_10.42.42.10(pid=8011): Launched 19:42:08.235368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:42:08.458586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:08.789939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Launched 19:42:09.077816 run iperf3-srv_10.42.42.10(pid=8013): Launched 19:42:09.201236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:42:09.424510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:09.756523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Launched 19:42:10.044468 run iperf3-srv_10.42.42.10(pid=8015): Launched 19:42:10.167731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:42:10.391041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:10.723326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Launched 19:42:11.011188 run iperf3-srv_10.42.42.10(pid=8017): Launched 19:42:11.135799 tst iperf3m4.py:8: start network... 19:42:11.359183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:11.871438 run create_hlr_db(pid=8018): Launched 19:42:11.997098 bus /gobi_6: Setting Powered False 19:42:13.061880 run create_hlr_db(pid=8018): Terminated: ok {rc=0} 19:42:13.502512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Launched 19:42:13.812185 run osmo-hlr_10.42.42.2(pid=8021): Launched 19:42:13.928480 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:14.461293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Launched 19:42:14.772187 run osmo-stp_10.42.42.5(pid=8024): Launched 19:42:14.889262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:15.421227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8026): Launched 19:42:15.538528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:15.798810 run patchelf(pid=8027): Launched 19:42:16.027398 run osmo-stp_10.42.42.5(pid=8024): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] 19:42:16.171781 run osmo-stp_10.42.42.5(pid=8024): stdout: | (launched: 2022-12-09_19:42:14.715123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:16.318600 run osmo-stp_10.42.42.5(pid=8024): stderr: | [0;m[38;5;43m20221209194214885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194214886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194214886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194214886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:16.463911 run osmo-stp_10.42.42.5(pid=8024): stdout: | (launched: 2022-12-09_19:42:14.715123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:16.605514 run osmo-stp_10.42.42.5(pid=8024): stderr: | [0;m[38;5;43m20221209194214885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194214886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194214886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194214886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194214887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:16.772887 run patchelf(pid=8027): Terminating (SIGINT) 19:42:16.963571 run patchelf(pid=8027): Terminated: ok {rc=0} 19:42:17.100839 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8024): Process ended prematurely: osmo-stp_10.42.42.5(pid=8024) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 19:42:17.111334 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:42:17.139360 run osmo-hlr_10.42.42.2(pid=8021): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8021)] 19:42:17.186921 run osmo-hlr_10.42.42.2(pid=8021): stdout: | (launched: 2022-12-09_19:42:13.755311) 19:42:17.235935 run osmo-hlr_10.42.42.2(pid=8021): stderr: | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194213929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194213945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194213954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194213954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194213954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:17.285486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8010): Terminating (SIGTERM) 19:42:17.325100 run iperf3-srv_10.42.42.10(pid=8011): Terminating (SIGTERM) 19:42:17.364385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Terminating (SIGTERM) 19:42:17.403807 run iperf3-srv_10.42.42.10(pid=8013): Terminating (SIGTERM) 19:42:17.443104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Terminating (SIGTERM) 19:42:17.484168 run iperf3-srv_10.42.42.10(pid=8015): Terminating (SIGTERM) 19:42:17.527334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Terminating (SIGTERM) 19:42:17.569934 run iperf3-srv_10.42.42.10(pid=8017): Terminating (SIGTERM) 19:42:17.612350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Terminating (SIGTERM) 19:42:17.654734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Terminating (SIGTERM) 19:42:17.696390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8026): Terminating (SIGTERM) 19:42:17.738403 --- ParallelTerminationStrategy: PID 8010 died... 19:42:17.758007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8010): Terminated: ok {rc=0} 19:42:17.804676 --- ParallelTerminationStrategy: PID 8011 died... 19:42:17.823956 run iperf3-srv_10.42.42.10(pid=8011): Terminated {rc=256} 19:42:17.870200 --- ParallelTerminationStrategy: PID 8012 died... 19:42:17.889514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Terminated: ok {rc=0} 19:42:17.936066 --- ParallelTerminationStrategy: PID 8013 died... 19:42:17.955707 run iperf3-srv_10.42.42.10(pid=8013): Terminated {rc=256} 19:42:18.001898 --- ParallelTerminationStrategy: PID 8014 died... 19:42:18.021291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8014): Terminated: ok {rc=0} 19:42:18.067811 --- ParallelTerminationStrategy: PID 8015 died... 19:42:18.087665 run iperf3-srv_10.42.42.10(pid=8015): Terminated {rc=256} 19:42:18.134131 --- ParallelTerminationStrategy: PID 8016 died... 19:42:18.153579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8016): Terminated: ok {rc=0} 19:42:18.200242 --- ParallelTerminationStrategy: PID 8017 died... 19:42:18.219716 run iperf3-srv_10.42.42.10(pid=8017): Terminated {rc=256} 19:42:18.266000 --- ParallelTerminationStrategy: PID 8020 died... 19:42:18.285501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8020): Terminated: ok {rc=0} 19:42:18.331620 --- ParallelTerminationStrategy: PID 8023 died... 19:42:18.351106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8023): Terminated: ok {rc=0} 19:42:18.397195 --- ParallelTerminationStrategy: PID 8026 died... 19:42:18.416537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8026): Terminated: ok {rc=0} 19:42:18.503236 bus /gobi_4: Setting Powered False 19:42:19.604288 bus /gobi_4: Setting Powered False 19:42:20.719342 bus /gobi_1: Setting Powered False 19:42:21.817281 bus /gobi_1: Setting Powered False 19:42:22.930228 bus /gobi_0: Setting Powered False 19:42:24.028747 bus /gobi_0: Setting Powered False 19:42:25.143134 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 19:42:26.245957 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.257850 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:42:26.298579 tst ping.py: using LAC 23281 19:42:26.418771 tst ping.py: using RAC 76 19:42:26.538526 tst ping.py: using CellId 23281 19:42:26.657723 tst ping.py: using BVCI 23282 19:42:26.766375 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.777353 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.788651 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.799403 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.810095 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.820714 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.831648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:26.842418 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:26.958922 tst ping.py:19: start network... 19:42:27.176303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:27.677349 run create_hlr_db(pid=8028): Launched 19:42:27.802293 bus /gobi_6: Setting Powered False 19:42:28.865960 run create_hlr_db(pid=8028): Terminated: ok {rc=0} 19:42:29.296574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8030): Launched 19:42:29.597947 run osmo-hlr_10.42.42.2(pid=8031): Launched 19:42:29.713855 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:30.255062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8033): Launched 19:42:30.555254 run osmo-stp_10.42.42.5(pid=8034): Launched 19:42:30.671130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:31.253723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8036): Launched 19:42:31.376762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:31.638566 run patchelf(pid=8037): Launched 19:42:31.871849 run osmo-stp_10.42.42.5(pid=8034): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8034)] 19:42:32.001525 run osmo-stp_10.42.42.5(pid=8034): stdout: | (launched: 2022-12-09_19:42:30.499643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:32.132551 run osmo-stp_10.42.42.5(pid=8034): stderr: | [0;m[38;5;43m20221209194230667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194230667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194230668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194230668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194230668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194230669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194230669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:32.264696 run osmo-stp_10.42.42.5(pid=8034): stdout: | (launched: 2022-12-09_19:42:30.499643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:32.389120 run osmo-stp_10.42.42.5(pid=8034): stderr: | [0;m[38;5;43m20221209194230667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194230667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194230668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194230668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194230668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194230669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194230669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:32.535013 run patchelf(pid=8037): Terminating (SIGINT) 19:42:32.703677 run patchelf(pid=8037): Terminated: ok {rc=0} 19:42:32.825127 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8034): Process ended prematurely: osmo-stp_10.42.42.5(pid=8034) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8034)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 19:42:32.834087 tst ping.py:22: Test FAILED (6.6 sec) 19:42:32.860564 run osmo-hlr_10.42.42.2(pid=8031): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8031)] 19:42:32.907975 run osmo-hlr_10.42.42.2(pid=8031): stdout: | (launched: 2022-12-09_19:42:29.542186) 19:42:32.956771 run osmo-hlr_10.42.42.2(pid=8031): stderr: | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194229717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194229729 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194229738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194229738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194229738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:33.006138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8030): Terminating (SIGTERM) 19:42:33.045552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8033): Terminating (SIGTERM) 19:42:33.084846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8036): Terminating (SIGTERM) 19:42:33.124471 --- ParallelTerminationStrategy: PID 8030 died... 19:42:33.143469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8030): Terminated: ok {rc=0} 19:42:33.187658 --- ParallelTerminationStrategy: PID 8033 died... 19:42:33.206244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8033): Terminated: ok {rc=0} 19:42:33.249819 --- ParallelTerminationStrategy: PID 8036 died... 19:42:33.268562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8036): Terminated: ok {rc=0} 19:42:33.354178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:42:34.443949 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:34.456048 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:42:34.500805 tst ping_idle_ping.py: using LAC 23282 19:42:34.618509 tst ping_idle_ping.py: using RAC 77 19:42:34.735109 tst ping_idle_ping.py: using CellId 23282 19:42:34.854576 tst ping_idle_ping.py: using BVCI 23283 19:42:34.965904 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:34.977128 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:34.987895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:34.998660 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:35.009390 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:35.020047 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:35.030980 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:35.041739 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:35.162564 tst ping_idle_ping.py:24: start network... 19:42:35.382362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:35.896476 run create_hlr_db(pid=8038): Launched 19:42:36.020813 bus /gobi_6: Setting Powered False 19:42:37.081803 run create_hlr_db(pid=8038): Terminated: ok {rc=0} 19:42:37.505518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8040): Launched 19:42:37.808057 run osmo-hlr_10.42.42.2(pid=8041): Launched 19:42:37.922773 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:38.457653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8043): Launched 19:42:38.760435 run osmo-stp_10.42.42.5(pid=8044): Launched 19:42:38.874943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:39.396672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8046): Launched 19:42:39.511932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:39.767307 run patchelf(pid=8047): Launched 19:42:39.935359 run osmo-stp_10.42.42.5(pid=8044): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8044)] 19:42:40.063070 run osmo-stp_10.42.42.5(pid=8044): stdout: | (launched: 2022-12-09_19:42:38.704650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:40.192452 run osmo-stp_10.42.42.5(pid=8044): stderr: | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194238875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194238875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194238875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194238876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:40.322391 run osmo-stp_10.42.42.5(pid=8044): stdout: | (launched: 2022-12-09_19:42:38.704650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:40.446044 run osmo-stp_10.42.42.5(pid=8044): stderr: | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194238874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194238875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194238875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194238875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194238876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:40.592616 run patchelf(pid=8047): Terminating (SIGINT) 19:42:40.761813 run patchelf(pid=8047): Terminated: ok {rc=0} 19:42:40.883458 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8044): Process ended prematurely: osmo-stp_10.42.42.5(pid=8044) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8044)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 19:42:40.892399 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:42:40.918806 run osmo-hlr_10.42.42.2(pid=8041): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8041)] 19:42:40.965926 run osmo-hlr_10.42.42.2(pid=8041): stdout: | (launched: 2022-12-09_19:42:37.752415) 19:42:41.014138 run osmo-hlr_10.42.42.2(pid=8041): stderr: | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194237928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194237940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194237949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194237949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194237949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:41.062778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8040): Terminating (SIGTERM) 19:42:41.101699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8043): Terminating (SIGTERM) 19:42:41.140753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8046): Terminating (SIGTERM) 19:42:41.180069 --- ParallelTerminationStrategy: PID 8040 died... 19:42:41.198914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8040): Terminated: ok {rc=0} 19:42:41.242383 --- ParallelTerminationStrategy: PID 8043 died... 19:42:41.260725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8043): Terminated: ok {rc=0} 19:42:41.304312 --- ParallelTerminationStrategy: PID 8046 died... 19:42:41.322851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8046): Terminated: ok {rc=0} 19:42:41.405138 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:42:42.702269 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:42:42.710392 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:42:42.733866 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:42:42.771469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:42:42.857451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:42:42.880928 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:42:42.918983 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:42:43.518053 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:42:43.572939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:43.584600 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:42:43.646506 tst cs_paging_gprs_active.py: using LAC 23283 19:42:43.777375 tst cs_paging_gprs_active.py: using RAC 78 19:42:43.904708 tst cs_paging_gprs_active.py: using CellId 23283 19:42:44.030677 tst cs_paging_gprs_active.py: using BVCI 23284 19:42:44.151026 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.162486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.173758 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.185150 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.196494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.207971 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.219440 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.230776 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:44.242644 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:44.360418 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:44.476902 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:42:44.684886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:44.993380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8051): Launched 19:42:45.260840 run iperf3-srv_10.42.42.10(pid=8052): Launched 19:42:45.376160 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:42:45.582443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:45.901615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8053): Launched 19:42:46.237783 run iperf3-srv_10.42.42.10(pid=8054): Launched 19:42:46.378961 tst cs_paging_gprs_active.py:38: start network... 19:42:46.609385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:47.135554 run create_hlr_db(pid=8055): Launched 19:42:47.263193 bus /gobi_6: Setting Powered False 19:42:48.325177 run create_hlr_db(pid=8055): Terminated: ok {rc=0} 19:42:48.773732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8057): Launched 19:42:49.104112 run osmo-hlr_10.42.42.2(pid=8058): Launched 19:42:49.229749 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:49.797044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8060): Launched 19:42:50.126340 run osmo-stp_10.42.42.5(pid=8061): Launched 19:42:50.251887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:50.819179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8063): Launched 19:42:50.946107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:51.223920 run patchelf(pid=8064): Launched 19:42:51.407582 run osmo-stp_10.42.42.5(pid=8061): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8061)] 19:42:51.547251 run osmo-stp_10.42.42.5(pid=8061): stdout: | (launched: 2022-12-09_19:42:50.066259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:51.688238 run osmo-stp_10.42.42.5(pid=8061): stderr: | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194250256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:51.828430 run osmo-stp_10.42.42.5(pid=8061): stdout: | (launched: 2022-12-09_19:42:50.066259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:51.963830 run osmo-stp_10.42.42.5(pid=8061): stderr: | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194250255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194250256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194250256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:52.123566 run patchelf(pid=8064): Terminating (SIGINT) 19:42:52.307433 run patchelf(pid=8064): Terminated: ok {rc=0} 19:42:52.440373 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8061): Process ended prematurely: osmo-stp_10.42.42.5(pid=8061) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8061)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:42:52.450820 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:42:52.479996 run osmo-hlr_10.42.42.2(pid=8058): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8058)] 19:42:52.530047 run osmo-hlr_10.42.42.2(pid=8058): stdout: | (launched: 2022-12-09_19:42:49.043815) 19:42:52.582323 run osmo-hlr_10.42.42.2(pid=8058): stderr: | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194249241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194249254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194249264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194249265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194249265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:52.634754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8051): Terminating (SIGTERM) 19:42:52.676454 run iperf3-srv_10.42.42.10(pid=8052): Terminating (SIGTERM) 19:42:52.718390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8053): Terminating (SIGTERM) 19:42:52.760136 run iperf3-srv_10.42.42.10(pid=8054): Terminating (SIGTERM) 19:42:52.801887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8057): Terminating (SIGTERM) 19:42:52.843561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8060): Terminating (SIGTERM) 19:42:52.885279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8063): Terminating (SIGTERM) 19:42:52.927296 --- ParallelTerminationStrategy: PID 8051 died... 19:42:52.946933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8051): Terminated: ok {rc=0} 19:42:52.993462 --- ParallelTerminationStrategy: PID 8052 died... 19:42:53.012890 run iperf3-srv_10.42.42.10(pid=8052): Terminated {rc=256} 19:42:53.059185 --- ParallelTerminationStrategy: PID 8053 died... 19:42:53.078572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8053): Terminated: ok {rc=0} 19:42:53.124937 --- ParallelTerminationStrategy: PID 8054 died... 19:42:53.144361 run iperf3-srv_10.42.42.10(pid=8054): Terminated {rc=256} 19:42:53.190399 --- ParallelTerminationStrategy: PID 8057 died... 19:42:53.209831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8057): Terminated: ok {rc=0} 19:42:53.255864 --- ParallelTerminationStrategy: PID 8060 died... 19:42:53.275451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8060): Terminated: ok {rc=0} 19:42:53.321780 --- ParallelTerminationStrategy: PID 8063 died... 19:42:53.341303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8063): Terminated: ok {rc=0} 19:42:53.429319 bus /gobi_0: Setting Powered False 19:42:54.528198 bus /gobi_0: Setting Powered False 19:42:55.645540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:42:56.791918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:56.803625 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:42:56.866197 tst iperf3.py: using LAC 23284 19:42:56.995606 tst iperf3.py: using RAC 79 19:42:57.122810 tst iperf3.py: using CellId 23284 19:42:57.250230 tst iperf3.py: using BVCI 23285 19:42:57.364333 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.375558 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.386469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.398021 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.409417 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.420819 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.432576 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.443943 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:57.455369 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:57.571514 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:57.780001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:58.088462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8065): Launched 19:42:58.356845 run iperf3-srv_10.42.42.10(pid=8066): Launched 19:42:58.472597 tst iperf3.py:8: start network... 19:42:58.679665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:59.156629 run create_hlr_db(pid=8067): Launched 19:42:59.281372 bus /gobi_6: Setting Powered False 19:43:00.342657 run create_hlr_db(pid=8067): Terminated: ok {rc=0} 19:43:00.792406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8069): Launched 19:43:01.135139 run osmo-hlr_10.42.42.2(pid=8070): Launched 19:43:01.324540 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:02.105897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8072): Launched 19:43:02.448735 run osmo-stp_10.42.42.5(pid=8073): Launched 19:43:02.574456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:03.141725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8075): Launched 19:43:03.267990 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:03.546063 run patchelf(pid=8076): Launched 19:43:03.728213 run osmo-stp_10.42.42.5(pid=8073): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8073)] 19:43:03.867106 run osmo-stp_10.42.42.5(pid=8073): stdout: | (launched: 2022-12-09_19:43:02.388448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:04.007713 run osmo-stp_10.42.42.5(pid=8073): stderr: | [0;m[38;5;43m20221209194302582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194302583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194302583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194302583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:04.148066 run osmo-stp_10.42.42.5(pid=8073): stdout: | (launched: 2022-12-09_19:43:02.388448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:04.282444 run osmo-stp_10.42.42.5(pid=8073): stderr: | [0;m[38;5;43m20221209194302582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194302583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194302583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194302583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194302584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:04.442054 run patchelf(pid=8076): Terminating (SIGINT) 19:43:04.625790 run patchelf(pid=8076): Terminated: ok {rc=0} 19:43:04.758318 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8073): Process ended prematurely: osmo-stp_10.42.42.5(pid=8073) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8073)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 19:43:04.768670 tst iperf3.py:8: Test FAILED (8.0 sec) 19:43:04.797632 run osmo-hlr_10.42.42.2(pid=8070): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8070)] 19:43:04.848228 run osmo-hlr_10.42.42.2(pid=8070): stdout: | (launched: 2022-12-09_19:43:01.075292) 19:43:04.900073 run osmo-hlr_10.42.42.2(pid=8070): stderr: | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194301424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194301455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194301470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194301470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194301470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:04.952408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8065): Terminating (SIGTERM) 19:43:04.994457 run iperf3-srv_10.42.42.10(pid=8066): Terminating (SIGTERM) 19:43:05.036525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8069): Terminating (SIGTERM) 19:43:05.078532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8072): Terminating (SIGTERM) 19:43:05.120266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8075): Terminating (SIGTERM) 19:43:05.162362 --- ParallelTerminationStrategy: PID 8065 died... 19:43:05.182328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8065): Terminated: ok {rc=0} 19:43:05.228673 --- ParallelTerminationStrategy: PID 8066 died... 19:43:05.247957 run iperf3-srv_10.42.42.10(pid=8066): Terminated {rc=256} 19:43:05.294371 --- ParallelTerminationStrategy: PID 8069 died... 19:43:05.314248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8069): Terminated: ok {rc=0} 19:43:05.360677 --- ParallelTerminationStrategy: PID 8072 died... 19:43:05.380378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8072): Terminated: ok {rc=0} 19:43:05.426263 --- ParallelTerminationStrategy: PID 8075 died... 19:43:05.445636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8075): Terminated: ok {rc=0} 19:43:05.532859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:43:06.680062 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.691911 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:43:06.750238 tst iperf3m4.py: using LAC 23285 19:43:06.870591 tst iperf3m4.py: using RAC 80 19:43:07.001598 tst iperf3m4.py: using CellId 23285 19:43:07.126739 tst iperf3m4.py: using BVCI 23286 19:43:07.238247 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.249549 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.260501 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.271297 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.282234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.293198 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.304019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.314986 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:07.326119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:07.442332 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:07.562787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:07.683500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:07.803171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:43:08.009664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:08.317362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8077): Launched 19:43:08.585118 run iperf3-srv_10.42.42.10(pid=8078): Launched 19:43:08.699985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:43:08.905495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:09.213741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8079): Launched 19:43:09.480249 run iperf3-srv_10.42.42.10(pid=8080): Launched 19:43:09.595329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:43:09.801703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:10.110310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8081): Launched 19:43:10.378470 run iperf3-srv_10.42.42.10(pid=8082): Launched 19:43:10.495136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:43:10.700567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:11.010096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Launched 19:43:11.278603 run iperf3-srv_10.42.42.10(pid=8084): Launched 19:43:11.394427 tst iperf3m4.py:8: start network... 19:43:11.599557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:12.074583 run create_hlr_db(pid=8085): Launched 19:43:12.201453 bus /gobi_6: Setting Powered False 19:43:13.262725 run create_hlr_db(pid=8085): Terminated: ok {rc=0} 19:43:13.689971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8087): Launched 19:43:13.997516 run osmo-hlr_10.42.42.2(pid=8088): Launched 19:43:14.114142 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:14.642818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8090): Launched 19:43:14.949489 run osmo-stp_10.42.42.5(pid=8091): Launched 19:43:15.065998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:15.596219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8093): Launched 19:43:15.713342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:15.989740 run patchelf(pid=8094): Launched 19:43:16.192155 run osmo-stp_10.42.42.5(pid=8091): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8091)] 19:43:16.325448 run osmo-stp_10.42.42.5(pid=8091): stdout: | (launched: 2022-12-09_19:43:14.892660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:16.461233 run osmo-stp_10.42.42.5(pid=8091): stderr: | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194315063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:16.596708 run osmo-stp_10.42.42.5(pid=8091): stdout: | (launched: 2022-12-09_19:43:14.892660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:16.726983 run osmo-stp_10.42.42.5(pid=8091): stderr: | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194315062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194315063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194315063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:16.878814 run patchelf(pid=8094): Terminating (SIGINT) 19:43:17.092403 run patchelf(pid=8094): Terminated: ok {rc=0} 19:43:17.222387 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8091): Process ended prematurely: osmo-stp_10.42.42.5(pid=8091) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8091)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:43:17.233103 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:43:17.261238 run osmo-hlr_10.42.42.2(pid=8088): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8088)] 19:43:17.308685 run osmo-hlr_10.42.42.2(pid=8088): stdout: | (launched: 2022-12-09_19:43:13.940494) 19:43:17.357621 run osmo-hlr_10.42.42.2(pid=8088): stderr: | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194314118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194314130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194314141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194314141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194314141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:17.406889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8077): Terminating (SIGTERM) 19:43:17.446013 run iperf3-srv_10.42.42.10(pid=8078): Terminating (SIGTERM) 19:43:17.485208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8079): Terminating (SIGTERM) 19:43:17.524362 run iperf3-srv_10.42.42.10(pid=8080): Terminating (SIGTERM) 19:43:17.563482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8081): Terminating (SIGTERM) 19:43:17.602454 run iperf3-srv_10.42.42.10(pid=8082): Terminating (SIGTERM) 19:43:17.641411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Terminating (SIGTERM) 19:43:17.680939 run iperf3-srv_10.42.42.10(pid=8084): Terminating (SIGTERM) 19:43:17.720014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8087): Terminating (SIGTERM) 19:43:17.759410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8090): Terminating (SIGTERM) 19:43:17.798692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8093): Terminating (SIGTERM) 19:43:17.838445 --- ParallelTerminationStrategy: PID 8077 died... 19:43:17.857774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8077): Terminated: ok {rc=0} 19:43:17.902278 --- ParallelTerminationStrategy: PID 8078 died... 19:43:17.920792 run iperf3-srv_10.42.42.10(pid=8078): Terminated {rc=256} 19:43:17.964510 --- ParallelTerminationStrategy: PID 8079 died... 19:43:17.983071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8079): Terminated: ok {rc=0} 19:43:18.026646 --- ParallelTerminationStrategy: PID 8080 died... 19:43:18.045294 run iperf3-srv_10.42.42.10(pid=8080): Terminated {rc=256} 19:43:18.088723 --- ParallelTerminationStrategy: PID 8081 died... 19:43:18.107449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8081): Terminated: ok {rc=0} 19:43:18.151115 --- ParallelTerminationStrategy: PID 8082 died... 19:43:18.169729 run iperf3-srv_10.42.42.10(pid=8082): Terminated {rc=256} 19:43:18.213590 --- ParallelTerminationStrategy: PID 8083 died... 19:43:18.232323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Terminated: ok {rc=0} 19:43:18.275813 --- ParallelTerminationStrategy: PID 8084 died... 19:43:18.294478 run iperf3-srv_10.42.42.10(pid=8084): Terminated {rc=256} 19:43:18.338174 --- ParallelTerminationStrategy: PID 8087 died... 19:43:18.356862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8087): Terminated: ok {rc=0} 19:43:18.400395 --- ParallelTerminationStrategy: PID 8090 died... 19:43:18.419189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8090): Terminated: ok {rc=0} 19:43:18.463158 --- ParallelTerminationStrategy: PID 8093 died... 19:43:18.482108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8093): Terminated: ok {rc=0} 19:43:18.569123 bus /gobi_4: Setting Powered False 19:43:19.670274 bus /gobi_4: Setting Powered False 19:43:20.787010 bus /gobi_1: Setting Powered False 19:43:21.885741 bus /gobi_1: Setting Powered False 19:43:22.999461 bus /gobi_0: Setting Powered False 19:43:24.097584 bus /gobi_0: Setting Powered False 19:43:25.217254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:43:26.320303 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.332011 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:43:26.392519 tst ping.py: using LAC 23286 19:43:26.512392 tst ping.py: using RAC 81 19:43:26.633093 tst ping.py: using CellId 23286 19:43:26.752674 tst ping.py: using BVCI 23287 19:43:26.861690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.872942 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.883791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.894690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.905967 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.916849 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.927877 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:26.938874 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:27.053353 tst ping.py:19: start network... 19:43:27.257579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:27.726827 run create_hlr_db(pid=8095): Launched 19:43:27.851858 bus /gobi_6: Setting Powered False 19:43:28.911780 run create_hlr_db(pid=8095): Terminated: ok {rc=0} 19:43:29.356499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Launched 19:43:29.683552 run osmo-hlr_10.42.42.2(pid=8098): Launched 19:43:29.808714 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:30.378358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Launched 19:43:30.704067 run osmo-stp_10.42.42.5(pid=8101): Launched 19:43:30.837332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:31.493935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8103): Launched 19:43:31.620515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:31.901764 run patchelf(pid=8104): Launched 19:43:32.076733 run osmo-stp_10.42.42.5(pid=8101): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] 19:43:32.215201 run osmo-stp_10.42.42.5(pid=8101): stdout: | (launched: 2022-12-09_19:43:30.644480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:32.354607 run osmo-stp_10.42.42.5(pid=8101): stderr: | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194330836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:32.492455 run osmo-stp_10.42.42.5(pid=8101): stdout: | (launched: 2022-12-09_19:43:30.644480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:32.625195 run osmo-stp_10.42.42.5(pid=8101): stderr: | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194330835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194330836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194330838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:32.782628 run patchelf(pid=8104): Terminating (SIGINT) 19:43:32.962767 run patchelf(pid=8104): Terminated: ok {rc=0} 19:43:33.093086 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8101): Process ended prematurely: osmo-stp_10.42.42.5(pid=8101) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 19:43:33.103322 tst ping.py:22: Test FAILED (6.8 sec) 19:43:33.132144 run osmo-hlr_10.42.42.2(pid=8098): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8098)] 19:43:33.182217 run osmo-hlr_10.42.42.2(pid=8098): stdout: | (launched: 2022-12-09_19:43:29.623569) 19:43:33.234273 run osmo-hlr_10.42.42.2(pid=8098): stderr: | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194329826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194329838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194329847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194329847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194329847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:33.286145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Terminating (SIGTERM) 19:43:33.328308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Terminating (SIGTERM) 19:43:33.370182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8103): Terminating (SIGTERM) 19:43:33.412159 --- ParallelTerminationStrategy: PID 8097 died... 19:43:33.432187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Terminated: ok {rc=0} 19:43:33.478844 --- ParallelTerminationStrategy: PID 8100 died... 19:43:33.498545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Terminated: ok {rc=0} 19:43:33.544886 --- ParallelTerminationStrategy: PID 8103 died... 19:43:33.564585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8103): Terminated: ok {rc=0} 19:43:33.652094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:43:34.738485 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:34.751196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:43:34.814626 tst ping_idle_ping.py: using LAC 23287 19:43:34.941787 tst ping_idle_ping.py: using RAC 82 19:43:35.071393 tst ping_idle_ping.py: using CellId 23287 19:43:35.190246 tst ping_idle_ping.py: using BVCI 23288 19:43:35.299987 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.311222 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.322316 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.333352 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.344192 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.354963 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.365803 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:35.376467 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:35.494512 tst ping_idle_ping.py:24: start network... 19:43:35.698577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:36.171227 run create_hlr_db(pid=8105): Launched 19:43:36.295568 bus /gobi_6: Setting Powered False 19:43:37.359708 run create_hlr_db(pid=8105): Terminated: ok {rc=0} 19:43:37.793769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8107): Launched 19:43:38.097128 run osmo-hlr_10.42.42.2(pid=8108): Launched 19:43:38.211566 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:38.733690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8110): Launched 19:43:39.035394 run osmo-stp_10.42.42.5(pid=8111): Launched 19:43:39.149446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:39.668532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8113): Launched 19:43:39.783090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:40.038686 run patchelf(pid=8114): Launched 19:43:40.207405 run osmo-stp_10.42.42.5(pid=8111): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8111)] 19:43:40.334950 run osmo-stp_10.42.42.5(pid=8111): stdout: | (launched: 2022-12-09_19:43:38.979664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:40.463669 run osmo-stp_10.42.42.5(pid=8111): stderr: | [0;m[38;5;43m20221209194339152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194339152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194339153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194339153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194339153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194339154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194339154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:40.592486 run osmo-stp_10.42.42.5(pid=8111): stdout: | (launched: 2022-12-09_19:43:38.979664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:40.716290 run osmo-stp_10.42.42.5(pid=8111): stderr: | [0;m[38;5;43m20221209194339152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194339152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194339153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194339153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194339153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194339154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194339154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:40.863008 run patchelf(pid=8114): Terminating (SIGINT) 19:43:41.031555 run patchelf(pid=8114): Terminated: ok {rc=0} 19:43:41.152845 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8111): Process ended prematurely: osmo-stp_10.42.42.5(pid=8111) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8111)] [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:43:41.161972 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:43:41.188194 run osmo-hlr_10.42.42.2(pid=8108): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8108)] 19:43:41.235109 run osmo-hlr_10.42.42.2(pid=8108): stdout: | (launched: 2022-12-09_19:43:38.041129) 19:43:41.283642 run osmo-hlr_10.42.42.2(pid=8108): stderr: | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194338219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194338232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194338241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194338241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194338241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:41.332730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8107): Terminating (SIGTERM) 19:43:41.371916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8110): Terminating (SIGTERM) 19:43:41.411104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8113): Terminating (SIGTERM) 19:43:41.450506 --- ParallelTerminationStrategy: PID 8107 died... 19:43:41.469343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8107): Terminated: ok {rc=0} 19:43:41.512867 --- ParallelTerminationStrategy: PID 8110 died... 19:43:41.531835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8110): Terminated: ok {rc=0} 19:43:41.575119 --- ParallelTerminationStrategy: PID 8113 died... 19:43:41.593509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8113): Terminated: ok {rc=0} 19:43:41.678951 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 19:43:42.973789 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:43:42.981124 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:43:43.004571 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:43:43.038253 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:43:43.091480 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:43:43.115070 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:43:43.148587 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:43:43.709356 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:43:43.714394 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:43.725936 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:43:43.785401 tst switch_tch_pdch.py: using LAC 23288 19:43:43.904899 tst switch_tch_pdch.py: using RAC 83 19:43:44.023054 tst switch_tch_pdch.py: using CellId 23288 19:43:44.142849 tst switch_tch_pdch.py: using BVCI 23289 19:43:44.253579 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.265151 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.276417 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.287781 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.299045 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.310284 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.321738 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:43:44.333043 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:43:44.452097 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:43:44.572274 tst switch_tch_pdch.py:51: start network... 19:43:44.792036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:45.293469 run create_hlr_db(pid=8119): Launched 19:43:45.418192 bus /gobi_6: Setting Powered False 19:43:46.492008 run create_hlr_db(pid=8119): Terminated: ok {rc=0} 19:43:47.027566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8121): Launched 19:43:47.365450 run osmo-hlr_10.42.42.2(pid=8122): Launched 19:43:47.490896 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:48.047507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8124): Launched 19:43:48.370480 run osmo-stp_10.42.42.5(pid=8125): Launched 19:43:48.494285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:49.051456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Launched 19:43:49.175313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:49.446904 run patchelf(pid=8129): Launched 19:43:49.626685 run osmo-stp_10.42.42.5(pid=8125): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8125)] 19:43:49.762595 run osmo-stp_10.42.42.5(pid=8125): stdout: | (launched: 2022-12-09_19:43:48.311496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:49.899835 run osmo-stp_10.42.42.5(pid=8125): stderr: | [0;m[38;5;43m20221209194348503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194348503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194348504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194348504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:50.037325 run osmo-stp_10.42.42.5(pid=8125): stdout: | (launched: 2022-12-09_19:43:48.311496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:50.169040 run osmo-stp_10.42.42.5(pid=8125): stderr: | [0;m[38;5;43m20221209194348503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194348503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194348504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194348504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194348506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:50.325615 run patchelf(pid=8129): Terminating (SIGINT) 19:43:50.504916 run patchelf(pid=8129): Terminated: ok {rc=0} 19:43:50.634992 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8125): Process ended prematurely: osmo-stp_10.42.42.5(pid=8125) [trial-2363↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8125)] [trial-2363↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:43:50.644695 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:43:50.673298 run osmo-hlr_10.42.42.2(pid=8122): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8122)] 19:43:50.723216 run osmo-hlr_10.42.42.2(pid=8122): stdout: | (launched: 2022-12-09_19:43:47.306576) 19:43:50.774602 run osmo-hlr_10.42.42.2(pid=8122): stderr: | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194347508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194347520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194347529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194347529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194347529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:50.826862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8121): Terminating (SIGTERM) 19:43:50.868433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8124): Terminating (SIGTERM) 19:43:50.910206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Terminating (SIGTERM) 19:43:50.952106 --- ParallelTerminationStrategy: PID 8121 died... 19:43:50.971969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8121): Terminated: ok {rc=0} 19:43:51.018477 --- ParallelTerminationStrategy: PID 8124 died... 19:43:51.038070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8124): Terminated: ok {rc=0} 19:43:51.084238 --- ParallelTerminationStrategy: PID 8128 died... 19:43:51.103744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Terminated: ok {rc=0} 19:43:51.191780 bus /gobi_0: Setting Powered False 19:43:52.289465 bus /gobi_0: Setting Powered False 19:43:53.406884 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 sms:nanobts+band-900 --------------------------------------------------------------------- 19:43:54.654960 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:43:54.659761 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:43:54.691389 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:43:54.717612 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 19:43:54.769762 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:43:54.804435 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:43:54.832045 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 19:43:55.374148 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 19:43:55.379020 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.389642 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 19:43:55.435379 tst mo_mt_sms.py: using LAC 23289 19:43:55.553486 tst mo_mt_sms.py: using RAC 84 19:43:55.670080 tst mo_mt_sms.py: using CellId 23289 19:43:55.786318 tst mo_mt_sms.py: using BVCI 23290 19:43:55.894674 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.905655 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.916094 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.926446 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.936671 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:43:55.947043 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 19:43:56.066218 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 19:43:56.180638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:56.647228 run create_hlr_db(pid=8133): Launched 19:43:56.769275 bus /gobi_6: Setting Powered False 19:43:57.829388 run create_hlr_db(pid=8133): Terminated: ok {rc=0} 19:43:58.249769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8135): Launched 19:43:58.550598 run osmo-hlr_10.42.42.2(pid=8136): Launched 19:43:58.663847 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:59.180301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8138): Launched 19:43:59.480804 run osmo-stp_10.42.42.5(pid=8139): Launched 19:43:59.594946 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:00.139897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8141): Launched 19:44:00.441318 run osmo-msc_10.42.42.6(pid=8142): Launched 19:44:00.610476 run osmo-stp_10.42.42.5(pid=8139): ERR: Terminated: ERROR {rc=1} [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8139)] 19:44:00.738845 run osmo-stp_10.42.42.5(pid=8139): stdout: | (launched: 2022-12-09_19:43:59.425376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:00.882379 run osmo-stp_10.42.42.5(pid=8139): stderr: | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194359598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:01.010474 run osmo-stp_10.42.42.5(pid=8139): stdout: | (launched: 2022-12-09_19:43:59.425376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:01.132830 run osmo-stp_10.42.42.5(pid=8139): stderr: | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194359597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194359598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:01.279757 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8139): Process ended prematurely: osmo-stp_10.42.42.5(pid=8139) [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8139)] [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py:16] 19:44:01.289441 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 19:44:01.316736 run osmo-hlr_10.42.42.2(pid=8136): ERR: Terminated: ERROR {rc=237} [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8136)] 19:44:01.365044 run osmo-hlr_10.42.42.2(pid=8136): stdout: | (launched: 2022-12-09_19:43:58.494961) 19:44:01.415118 run osmo-hlr_10.42.42.2(pid=8136): stderr: | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194358671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194358683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194358692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194358692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194358692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:01.484229 run osmo-msc_10.42.42.6(pid=8142): ERR: Terminated: ERROR {rc=2} [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8142)] 19:44:01.532086 run osmo-msc_10.42.42.6(pid=8142): stdout: | (launched: 2022-12-09_19:44:00.385618) 19:44:01.581507 run osmo-msc_10.42.42.6(pid=8142): stderr: | [0;m[38;5;43m20221209194400656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194400657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd518f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194400657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194400657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194400657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194400657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194400659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194400659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194400660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194400660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:01.631356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8135): Terminating (SIGTERM) 19:44:01.671982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8138): Terminating (SIGTERM) 19:44:01.712898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8141): Terminating (SIGTERM) 19:44:01.756458 --- ParallelTerminationStrategy: PID 8135 died... 19:44:01.776095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8135): Terminated: ok {rc=0} 19:44:01.822125 --- ParallelTerminationStrategy: PID 8138 died... 19:44:01.841272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8138): Terminated: ok {rc=0} 19:44:01.887265 --- ParallelTerminationStrategy: PID 8141 died... 19:44:01.906704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8141): Terminated: ok {rc=0} 19:44:01.990806 bus /sierra_3: Setting Powered False 19:44:03.086031 bus /sierra_3: Setting Powered False 19:44:04.198241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 19:44:05.432574 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:05.437872 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:44:05.471259 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 19:44:05.478161 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 19:44:05.513402 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:44:05.546618 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 19:44:05.553518 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 19:44:06.073472 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 19:44:06.078630 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 19:44:06.089859 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 19:44:06.139099 tst assert_extension.py: using LAC 23290 19:44:06.266724 tst assert_extension.py: using RAC 85 19:44:06.392925 tst assert_extension.py: using CellId 23290 19:44:06.518552 tst assert_extension.py: using BVCI 23291 19:44:06.636047 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 19:44:06.752566 tst assert_extension.py:10: start nitb and bts... 19:44:06.971415 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:44:07.631733 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8147): Launched 19:44:07.935211 run osmo-nitb_10.42.42.2(pid=8148): Launched 19:44:08.101969 run osmo-nitb_10.42.42.2(pid=8148): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8148)] 19:44:08.236939 run osmo-nitb_10.42.42.2(pid=8148): stdout: | (launched: 2022-12-09_19:44:07.879141) 19:44:08.373626 run osmo-nitb_10.42.42.2(pid=8148): stderr: | (launched: 2022-12-09_19:44:07.924509) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:44:08.510042 run osmo-nitb_10.42.42.2(pid=8148): stdout: | (launched: 2022-12-09_19:44:07.879141) 19:44:08.641326 run osmo-nitb_10.42.42.2(pid=8148): stderr: | (launched: 2022-12-09_19:44:07.924509) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8148) [trial-2363↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8148)] 19:44:09.048500 tst osmo-nitb_10.42.42.2(pid=8148): stdout: | (launched: 2022-12-09_19:44:07.879141) 19:44:09.171848 tst osmo-nitb_10.42.42.2(pid=8148): stderr: | (launched: 2022-12-09_19:44:07.924509) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:44:09.315565 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8148) [trial-2363↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8148)] [trial-2363↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 19:44:09.324202 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:44:09.330936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8147): Terminating (SIGTERM) 19:44:09.538770 --- ParallelTerminationStrategy: PID 8147 died... 19:44:09.559484 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8147): Terminated: ok {rc=0} 19:44:09.644179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 ussd:nanobts+band-900 --------------------------------------------------------------------- 19:44:10.824704 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:10.830049 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:44:10.863645 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:44:10.890979 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 19:44:10.927420 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:44:10.961178 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:44:10.988402 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 19:44:11.516503 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 19:44:11.522052 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:11.533362 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 19:44:11.582525 tst assert_extension.py: using LAC 23291 19:44:11.712886 tst assert_extension.py: using RAC 86 19:44:11.839184 tst assert_extension.py: using CellId 23291 19:44:11.962647 tst assert_extension.py: using BVCI 23292 19:44:12.079459 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:12.090633 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:12.101822 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:12.113221 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:12.124597 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:44:12.135969 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 19:44:12.251610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:12.721048 run create_hlr_db(pid=8154): Launched 19:44:12.843966 bus /sierra_2: Setting Powered False 19:44:13.903439 run create_hlr_db(pid=8154): Terminated: ok {rc=0} 19:44:14.343021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Launched 19:44:14.666831 run osmo-hlr_10.42.42.2(pid=8157): Launched 19:44:14.792929 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:15.353875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Launched 19:44:15.677335 run osmo-stp_10.42.42.5(pid=8160): Launched 19:44:15.801515 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:16.501777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8162): Launched 19:44:16.836598 run osmo-msc_10.42.42.6(pid=8163): Launched 19:44:17.171663 run osmo-stp_10.42.42.5(pid=8160): ERR: Terminated: ERROR {rc=1} [trial-2363↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] 19:44:17.381487 run osmo-stp_10.42.42.5(pid=8160): stdout: | (launched: 2022-12-09_19:44:15.617939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:17.519008 run osmo-stp_10.42.42.5(pid=8160): stderr: | [0;m[38;5;43m20221209194415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194415814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194415814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:17.654129 run osmo-stp_10.42.42.5(pid=8160): stdout: | (launched: 2022-12-09_19:44:15.617939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:17.783717 run osmo-stp_10.42.42.5(pid=8160): stderr: | [0;m[38;5;43m20221209194415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194415814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194415814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194415815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:17.938286 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8160): Process ended prematurely: osmo-stp_10.42.42.5(pid=8160) [trial-2363↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] [trial-2363↪ussd:nanobts+band-900↪assert_extension.py:17] 19:44:17.947325 tst assert_extension.py:17: Test FAILED (6.4 sec) 19:44:17.975333 run osmo-hlr_10.42.42.2(pid=8157): ERR: Terminated: ERROR {rc=237} [trial-2363↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8157)] 19:44:18.025386 run osmo-hlr_10.42.42.2(pid=8157): stdout: | (launched: 2022-12-09_19:44:14.607329) 19:44:18.077318 run osmo-hlr_10.42.42.2(pid=8157): stderr: | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194414805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194414821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194414830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194414830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194414830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:18.149542 run osmo-msc_10.42.42.6(pid=8163): ERR: Terminated: ERROR {rc=2} [trial-2363↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8163)] 19:44:18.199474 run osmo-msc_10.42.42.6(pid=8163): stdout: | (launched: 2022-12-09_19:44:16.777481) 19:44:18.251068 run osmo-msc_10.42.42.6(pid=8163): stderr: | [0;m[38;5;43m20221209194417282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194417282 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb36c14bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194417282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194417282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194417283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194417283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194417284 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194417297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194417297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194417297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:18.303134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Terminating (SIGTERM) 19:44:18.344831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Terminating (SIGTERM) 19:44:18.386624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8162): Terminating (SIGTERM) 19:44:18.428387 --- ParallelTerminationStrategy: PID 8156 died... 19:44:18.448215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Terminated: ok {rc=0} 19:44:18.494855 --- ParallelTerminationStrategy: PID 8159 died... 19:44:18.514482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Terminated: ok {rc=0} 19:44:18.560661 --- ParallelTerminationStrategy: PID 8162 died... 19:44:18.580246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8162): Terminated: ok {rc=0} 19:44:18.668772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:44:19.879438 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:19.886966 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:44:19.918902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:44:19.944770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:44:19.995163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:44:20.028890 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:44:20.056587 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:44:20.609428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:44:20.663835 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:20.675739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:44:20.742129 tst mo_mt_call.py: using LAC 23292 19:44:20.870292 tst mo_mt_call.py: using RAC 87 19:44:21.000007 tst mo_mt_call.py: using CellId 23292 19:44:21.126260 tst mo_mt_call.py: using BVCI 23293 19:44:21.244826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:21.256558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:21.268018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:21.279640 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:21.291282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:21.303583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:44:21.421335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:44:21.539951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:22.049370 run create_hlr_db(pid=8168): Launched 19:44:22.175559 bus /sierra_2: Setting Powered False 19:44:23.240617 run create_hlr_db(pid=8168): Terminated: ok {rc=0} 19:44:23.680262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8170): Launched 19:44:24.010034 run osmo-hlr_10.42.42.2(pid=8171): Launched 19:44:24.136240 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:24.703914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8173): Launched 19:44:25.033536 run osmo-stp_10.42.42.5(pid=8174): Launched 19:44:25.159544 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:25.751975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8176): Launched 19:44:26.081259 run osmo-msc_10.42.42.6(pid=8177): Launched 19:44:26.264187 run osmo-stp_10.42.42.5(pid=8174): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8174)] 19:44:26.402405 run osmo-stp_10.42.42.5(pid=8174): stdout: | (launched: 2022-12-09_19:44:24.973588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:26.540367 run osmo-stp_10.42.42.5(pid=8174): stderr: | [0;m[38;5;43m20221209194425168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194425168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194425169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194425169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194425169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194425170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194425170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:26.678063 run osmo-stp_10.42.42.5(pid=8174): stdout: | (launched: 2022-12-09_19:44:24.973588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:26.808265 run osmo-stp_10.42.42.5(pid=8174): stderr: | [0;m[38;5;43m20221209194425168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194425168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194425169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194425169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194425169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194425170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194425170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:26.964552 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8174): Process ended prematurely: osmo-stp_10.42.42.5(pid=8174) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8174)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:44:26.974312 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:44:27.002748 run osmo-hlr_10.42.42.2(pid=8171): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8171)] 19:44:27.052625 run osmo-hlr_10.42.42.2(pid=8171): stdout: | (launched: 2022-12-09_19:44:23.950183) 19:44:27.104214 run osmo-hlr_10.42.42.2(pid=8171): stderr: | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194424150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194424162 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194424171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194424171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194424171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:27.176518 run osmo-msc_10.42.42.6(pid=8177): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8177)] 19:44:27.226454 run osmo-msc_10.42.42.6(pid=8177): stdout: | (launched: 2022-12-09_19:44:26.021082) 19:44:27.277987 run osmo-msc_10.42.42.6(pid=8177): stderr: | [0;m[38;5;43m20221209194426343 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194426343 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f482f018c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194426344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194426344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194426344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194426344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194426346 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194426346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194426346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194426346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:27.330124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8170): Terminating (SIGTERM) 19:44:27.371781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8173): Terminating (SIGTERM) 19:44:27.413448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8176): Terminating (SIGTERM) 19:44:27.455347 --- ParallelTerminationStrategy: PID 8170 died... 19:44:27.475317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8170): Terminated: ok {rc=0} 19:44:27.521816 --- ParallelTerminationStrategy: PID 8173 died... 19:44:27.541449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8173): Terminated: ok {rc=0} 19:44:27.588028 --- ParallelTerminationStrategy: PID 8176 died... 19:44:27.607451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8176): Terminated: ok {rc=0} 19:44:27.695419 bus /sierra_3: Setting Powered False 19:44:28.793291 bus /sierra_3: Setting Powered False 19:44:29.909656 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:44:31.060770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.074158 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:44:31.145573 tst mo_mt_call_osmux.py: using LAC 23293 19:44:31.266995 tst mo_mt_call_osmux.py: using RAC 88 19:44:31.396729 tst mo_mt_call_osmux.py: using CellId 23293 19:44:31.520594 tst mo_mt_call_osmux.py: using BVCI 23294 19:44:31.660080 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.671888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.684059 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.696061 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.709245 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:44:31.721540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:44:31.839671 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:44:31.960220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:32.445693 run create_hlr_db(pid=8179): Launched 19:44:32.571866 bus /sierra_2: Setting Powered False 19:44:33.632626 run create_hlr_db(pid=8179): Terminated: ok {rc=0} 19:44:34.080638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8181): Launched 19:44:34.409444 run osmo-hlr_10.42.42.2(pid=8182): Launched 19:44:34.535526 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:35.101917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8184): Launched 19:44:35.433076 run osmo-stp_10.42.42.5(pid=8185): Launched 19:44:35.558833 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:36.154856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8187): Launched 19:44:36.486676 run osmo-msc_10.42.42.6(pid=8188): Launched 19:44:36.671721 run osmo-stp_10.42.42.5(pid=8185): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8185)] 19:44:36.810866 run osmo-stp_10.42.42.5(pid=8185): stdout: | (launched: 2022-12-09_19:44:35.372811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:36.950369 run osmo-stp_10.42.42.5(pid=8185): stderr: | [0;m[38;5;43m20221209194435568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194435569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194435569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194435569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:37.087813 run osmo-stp_10.42.42.5(pid=8185): stdout: | (launched: 2022-12-09_19:44:35.372811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:37.219502 run osmo-stp_10.42.42.5(pid=8185): stderr: | [0;m[38;5;43m20221209194435568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194435569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194435569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194435569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194435570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:37.376566 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8185): Process ended prematurely: osmo-stp_10.42.42.5(pid=8185) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8185)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:44:37.386454 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:44:37.414947 run osmo-hlr_10.42.42.2(pid=8182): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8182)] 19:44:37.465208 run osmo-hlr_10.42.42.2(pid=8182): stdout: | (launched: 2022-12-09_19:44:34.349449) 19:44:37.516871 run osmo-hlr_10.42.42.2(pid=8182): stderr: | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194434551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194434564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194434572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194434573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194434573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:37.589119 run osmo-msc_10.42.42.6(pid=8188): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8188)] 19:44:37.639610 run osmo-msc_10.42.42.6(pid=8188): stdout: | (launched: 2022-12-09_19:44:36.426457) 19:44:37.691198 run osmo-msc_10.42.42.6(pid=8188): stderr: | [0;m[38;5;43m20221209194436750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194436751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60f7d58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194436751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194436751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194436751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194436751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194436753 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194436753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194436753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194436753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:37.742954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8181): Terminating (SIGTERM) 19:44:37.784689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8184): Terminating (SIGTERM) 19:44:37.826523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8187): Terminating (SIGTERM) 19:44:37.868504 --- ParallelTerminationStrategy: PID 8181 died... 19:44:37.888515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8181): Terminated: ok {rc=0} 19:44:37.935176 --- ParallelTerminationStrategy: PID 8184 died... 19:44:37.954590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8184): Terminated: ok {rc=0} 19:44:38.000807 --- ParallelTerminationStrategy: PID 8187 died... 19:44:38.020711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8187): Terminated: ok {rc=0} 19:44:38.108846 bus /sierra_3: Setting Powered False 19:44:39.207431 bus /sierra_3: Setting Powered False 19:44:40.322031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:44:41.576342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:41.584480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:44:41.618009 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:44:41.645742 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:44:41.699123 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:44:41.732177 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:44:41.759420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:44:42.310627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:44:42.363641 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.375199 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:44:42.442658 tst mo_mt_call.py: using LAC 23294 19:44:42.570879 tst mo_mt_call.py: using RAC 89 19:44:42.692084 tst mo_mt_call.py: using CellId 23294 19:44:42.813146 tst mo_mt_call.py: using BVCI 23295 19:44:42.924021 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.935416 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.946635 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.957963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.969396 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:42.980430 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:44:43.096355 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:44:43.215032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:43.724658 run create_hlr_db(pid=8193): Launched 19:44:43.851974 bus /sierra_2: Setting Powered False 19:44:44.916432 run create_hlr_db(pid=8193): Terminated: ok {rc=0} 19:44:45.372146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8195): Launched 19:44:45.701703 run osmo-hlr_10.42.42.2(pid=8196): Launched 19:44:45.838653 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:46.515409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8198): Launched 19:44:46.859177 run osmo-stp_10.42.42.5(pid=8199): Launched 19:44:47.134042 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:47.752378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8201): Launched 19:44:48.081124 run osmo-msc_10.42.42.6(pid=8202): Launched 19:44:48.265603 run osmo-stp_10.42.42.5(pid=8199): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8199)] 19:44:48.403597 run osmo-stp_10.42.42.5(pid=8199): stdout: | (launched: 2022-12-09_19:44:46.799176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:48.542374 run osmo-stp_10.42.42.5(pid=8199): stderr: | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194447026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:48.680461 run osmo-stp_10.42.42.5(pid=8199): stdout: | (launched: 2022-12-09_19:44:46.799176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:48.811040 run osmo-stp_10.42.42.5(pid=8199): stderr: | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194447026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194447026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194447027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:48.967230 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8199): Process ended prematurely: osmo-stp_10.42.42.5(pid=8199) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8199)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:44:48.976867 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:44:49.004831 run osmo-hlr_10.42.42.2(pid=8196): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8196)] 19:44:49.054841 run osmo-hlr_10.42.42.2(pid=8196): stdout: | (launched: 2022-12-09_19:44:45.641748) 19:44:49.106261 run osmo-hlr_10.42.42.2(pid=8196): stderr: | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194445841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194445859 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194445877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194445877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194445877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:49.177892 run osmo-msc_10.42.42.6(pid=8202): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8202)] 19:44:49.227696 run osmo-msc_10.42.42.6(pid=8202): stdout: | (launched: 2022-12-09_19:44:48.021179) 19:44:49.279047 run osmo-msc_10.42.42.6(pid=8202): stderr: | [0;m[38;5;43m20221209194448344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194448344 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25da228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194448344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194448344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194448345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194448345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194448346 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194448347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194448347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194448347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:49.330814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8195): Terminating (SIGTERM) 19:44:49.372433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8198): Terminating (SIGTERM) 19:44:49.414253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8201): Terminating (SIGTERM) 19:44:49.456196 --- ParallelTerminationStrategy: PID 8195 died... 19:44:49.476077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8195): Terminated: ok {rc=0} 19:44:49.522499 --- ParallelTerminationStrategy: PID 8198 died... 19:44:49.541928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8198): Terminated: ok {rc=0} 19:44:49.588098 --- ParallelTerminationStrategy: PID 8201 died... 19:44:49.607494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8201): Terminated: ok {rc=0} 19:44:49.695114 bus /sierra_3: Setting Powered False 19:44:50.794068 bus /sierra_3: Setting Powered False 19:44:51.910793 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:44:53.056094 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.067864 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:44:53.134192 tst mo_mt_call_osmux.py: using LAC 23295 19:44:53.258675 tst mo_mt_call_osmux.py: using RAC 90 19:44:53.379263 tst mo_mt_call_osmux.py: using CellId 23295 19:44:53.498605 tst mo_mt_call_osmux.py: using BVCI 23296 19:44:53.609152 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.620163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.631066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.642006 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.653084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:44:53.663857 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:44:53.779216 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:44:53.899393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:54.410754 run create_hlr_db(pid=8204): Launched 19:44:54.538687 bus /sierra_2: Setting Powered False 19:44:55.603720 run create_hlr_db(pid=8204): Terminated: ok {rc=0} 19:44:56.061627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8206): Launched 19:44:56.390667 run osmo-hlr_10.42.42.2(pid=8207): Launched 19:44:56.517964 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:57.085028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8209): Launched 19:44:57.414435 run osmo-stp_10.42.42.5(pid=8210): Launched 19:44:57.541549 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:58.137515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8212): Launched 19:44:58.467258 run osmo-msc_10.42.42.6(pid=8213): Launched 19:44:58.652383 run osmo-stp_10.42.42.5(pid=8210): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8210)] 19:44:58.791081 run osmo-stp_10.42.42.5(pid=8210): stdout: | (launched: 2022-12-09_19:44:57.354270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:58.930454 run osmo-stp_10.42.42.5(pid=8210): stderr: | [0;m[38;5;43m20221209194457548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194457548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194457549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194457549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194457551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194457552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194457552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:59.061598 run osmo-stp_10.42.42.5(pid=8210): stdout: | (launched: 2022-12-09_19:44:57.354270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:59.183993 run osmo-stp_10.42.42.5(pid=8210): stderr: | [0;m[38;5;43m20221209194457548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194457548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194457549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194457549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194457551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194457552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194457552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:59.330563 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8210): Process ended prematurely: osmo-stp_10.42.42.5(pid=8210) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8210)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:44:59.340006 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:44:59.366812 run osmo-hlr_10.42.42.2(pid=8207): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8207)] 19:44:59.414310 run osmo-hlr_10.42.42.2(pid=8207): stdout: | (launched: 2022-12-09_19:44:56.330844) 19:44:59.463605 run osmo-hlr_10.42.42.2(pid=8207): stderr: | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194456529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194456542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194456552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194456552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194456553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:59.532041 run osmo-msc_10.42.42.6(pid=8213): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8213)] 19:44:59.579412 run osmo-msc_10.42.42.6(pid=8213): stdout: | (launched: 2022-12-09_19:44:58.406858) 19:44:59.628072 run osmo-msc_10.42.42.6(pid=8213): stderr: | [0;m[38;5;43m20221209194458729 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194458729 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe95ff3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194458729 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194458729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194458729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194458730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194458731 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194458732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194458732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194458732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:44:59.677286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8206): Terminating (SIGTERM) 19:44:59.716469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8209): Terminating (SIGTERM) 19:44:59.755795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8212): Terminating (SIGTERM) 19:44:59.795472 --- ParallelTerminationStrategy: PID 8206 died... 19:44:59.814557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8206): Terminated: ok {rc=0} 19:44:59.858552 --- ParallelTerminationStrategy: PID 8209 died... 19:44:59.877070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8209): Terminated: ok {rc=0} 19:44:59.920899 --- ParallelTerminationStrategy: PID 8212 died... 19:44:59.939744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8212): Terminated: ok {rc=0} 19:45:00.024807 bus /sierra_3: Setting Powered False 19:45:01.149148 bus /sierra_3: Setting Powered False 19:45:02.279957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:45:03.525042 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:03.532643 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:45:03.564551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:45:03.591222 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:45:03.644018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:45:03.675844 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:45:03.701974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:45:04.251614 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:45:04.300652 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.311811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:45:04.377469 tst mo_mt_call.py: using LAC 23296 19:45:04.497461 tst mo_mt_call.py: using RAC 91 19:45:04.617433 tst mo_mt_call.py: using CellId 23296 19:45:04.737043 tst mo_mt_call.py: using BVCI 23297 19:45:04.847748 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.858908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.869864 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.880626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.891603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:04.902628 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:45:05.021881 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:45:05.143009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:05.654819 run create_hlr_db(pid=8221): Launched 19:45:05.782586 bus /sierra_2: Setting Powered False 19:45:06.847812 run create_hlr_db(pid=8221): Terminated: ok {rc=0} 19:45:07.288444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8223): Launched 19:45:07.596314 run osmo-hlr_10.42.42.2(pid=8224): Launched 19:45:07.713251 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:08.240289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8226): Launched 19:45:08.546674 run osmo-stp_10.42.42.5(pid=8227): Launched 19:45:08.665136 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:09.219555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8229): Launched 19:45:09.527608 run osmo-msc_10.42.42.6(pid=8230): Launched 19:45:09.698683 run osmo-stp_10.42.42.5(pid=8227): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8227)] 19:45:09.828009 run osmo-stp_10.42.42.5(pid=8227): stdout: | (launched: 2022-12-09_19:45:08.490275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:09.957265 run osmo-stp_10.42.42.5(pid=8227): stderr: | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194508663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194508663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194508663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194508664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:10.084363 run osmo-stp_10.42.42.5(pid=8227): stdout: | (launched: 2022-12-09_19:45:08.490275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:10.206313 run osmo-stp_10.42.42.5(pid=8227): stderr: | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194508662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194508663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194508663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194508663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194508664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:10.352196 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8227): Process ended prematurely: osmo-stp_10.42.42.5(pid=8227) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8227)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:45:10.361148 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:45:10.387159 run osmo-hlr_10.42.42.2(pid=8224): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8224)] 19:45:10.433787 run osmo-hlr_10.42.42.2(pid=8224): stdout: | (launched: 2022-12-09_19:45:07.539849) 19:45:10.482067 run osmo-hlr_10.42.42.2(pid=8224): stderr: | [0;m[1;31m20221209194507717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194507718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194507718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194507718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194507718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194507718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194507734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194507745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194507745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194507745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:10.549932 run osmo-msc_10.42.42.6(pid=8230): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8230)] 19:45:10.596595 run osmo-msc_10.42.42.6(pid=8230): stdout: | (launched: 2022-12-09_19:45:09.470752) 19:45:10.644684 run osmo-msc_10.42.42.6(pid=8230): stderr: | [0;m[38;5;43m20221209194509745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194509745 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f76b54a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194509745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194509745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194509745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194509745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194509749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194509750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194509750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194509751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:10.693206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8223): Terminating (SIGTERM) 19:45:10.732186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8226): Terminating (SIGTERM) 19:45:10.771194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8229): Terminating (SIGTERM) 19:45:10.810771 --- ParallelTerminationStrategy: PID 8223 died... 19:45:10.829716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8223): Terminated: ok {rc=0} 19:45:10.873549 --- ParallelTerminationStrategy: PID 8226 died... 19:45:10.892011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8226): Terminated: ok {rc=0} 19:45:10.935263 --- ParallelTerminationStrategy: PID 8229 died... 19:45:10.954068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8229): Terminated: ok {rc=0} 19:45:11.039240 bus /sierra_3: Setting Powered False 19:45:12.137632 bus /sierra_3: Setting Powered False 19:45:13.251720 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:45:14.396342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:14.408083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:45:14.474914 tst mo_mt_call_osmux.py: using LAC 23297 19:45:14.594476 tst mo_mt_call_osmux.py: using RAC 92 19:45:14.714408 tst mo_mt_call_osmux.py: using CellId 23297 19:45:14.836412 tst mo_mt_call_osmux.py: using BVCI 23298 19:45:14.948793 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:14.960040 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:14.971042 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:14.982343 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:14.993413 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:45:15.004315 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:45:15.124207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:45:15.244714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:15.724466 run create_hlr_db(pid=8232): Launched 19:45:15.863504 bus /sierra_2: Setting Powered False 19:45:16.923551 run create_hlr_db(pid=8232): Terminated: ok {rc=0} 19:45:17.413158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8234): Launched 19:45:17.743993 run osmo-hlr_10.42.42.2(pid=8235): Launched 19:45:17.871784 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:18.438477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8237): Launched 19:45:18.767845 run osmo-stp_10.42.42.5(pid=8238): Launched 19:45:18.894657 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:19.489561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8240): Launched 19:45:19.819114 run osmo-msc_10.42.42.6(pid=8241): Launched 19:45:20.003112 run osmo-stp_10.42.42.5(pid=8238): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8238)] 19:45:20.141303 run osmo-stp_10.42.42.5(pid=8238): stdout: | (launched: 2022-12-09_19:45:18.708081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:20.279950 run osmo-stp_10.42.42.5(pid=8238): stderr: | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194518902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:20.417616 run osmo-stp_10.42.42.5(pid=8238): stdout: | (launched: 2022-12-09_19:45:18.708081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:20.548746 run osmo-stp_10.42.42.5(pid=8238): stderr: | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194518902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194518902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194518904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:20.705524 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8238): Process ended prematurely: osmo-stp_10.42.42.5(pid=8238) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8238)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:45:20.715258 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:45:20.743662 run osmo-hlr_10.42.42.2(pid=8235): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8235)] 19:45:20.793167 run osmo-hlr_10.42.42.2(pid=8235): stdout: | (launched: 2022-12-09_19:45:17.683701) 19:45:20.844826 run osmo-hlr_10.42.42.2(pid=8235): stderr: | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194517885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194517897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194517906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194517906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194517906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:20.916268 run osmo-msc_10.42.42.6(pid=8241): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8241)] 19:45:20.965588 run osmo-msc_10.42.42.6(pid=8241): stdout: | (launched: 2022-12-09_19:45:19.759022) 19:45:21.016793 run osmo-msc_10.42.42.6(pid=8241): stderr: | [0;m[38;5;43m20221209194520081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194520081 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f757774dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194520081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194520081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194520081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194520081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194520083 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194520083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194520084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194520084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:21.068387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8234): Terminating (SIGTERM) 19:45:21.110156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8237): Terminating (SIGTERM) 19:45:21.152011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8240): Terminating (SIGTERM) 19:45:21.193708 --- ParallelTerminationStrategy: PID 8234 died... 19:45:21.213465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8234): Terminated: ok {rc=0} 19:45:21.259657 --- ParallelTerminationStrategy: PID 8237 died... 19:45:21.278919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8237): Terminated: ok {rc=0} 19:45:21.325118 --- ParallelTerminationStrategy: PID 8240 died... 19:45:21.344568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8240): Terminated: ok {rc=0} 19:45:21.431479 bus /sierra_3: Setting Powered False 19:45:22.528408 bus /sierra_3: Setting Powered False 19:45:23.643445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:45:24.893756 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:24.902299 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:45:24.934877 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:45:24.961511 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:45:25.013952 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:45:25.046033 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:45:25.071993 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:45:25.624310 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:45:25.673193 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:25.684140 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:45:25.749486 tst mo_mt_call.py: using LAC 23298 19:45:25.869332 tst mo_mt_call.py: using RAC 93 19:45:25.988886 tst mo_mt_call.py: using CellId 23298 19:45:26.109004 tst mo_mt_call.py: using BVCI 23299 19:45:26.219597 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:26.230747 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:26.241704 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:26.252650 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:26.263671 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:26.274630 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:45:26.387991 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:45:26.504167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:26.981530 run create_hlr_db(pid=8246): Launched 19:45:27.106396 bus /sierra_2: Setting Powered False 19:45:28.167464 run create_hlr_db(pid=8246): Terminated: ok {rc=0} 19:45:28.615990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8248): Launched 19:45:28.945255 run osmo-hlr_10.42.42.2(pid=8249): Launched 19:45:29.071661 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:29.641859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8251): Launched 19:45:29.970704 run osmo-stp_10.42.42.5(pid=8252): Launched 19:45:30.095504 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:30.690721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8254): Launched 19:45:31.041679 run osmo-msc_10.42.42.6(pid=8255): Launched 19:45:31.500865 run osmo-stp_10.42.42.5(pid=8252): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8252)] 19:45:31.783725 run osmo-stp_10.42.42.5(pid=8252): stdout: | (launched: 2022-12-09_19:45:29.910854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:31.985893 run osmo-stp_10.42.42.5(pid=8252): stderr: | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194530104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:32.117208 run osmo-stp_10.42.42.5(pid=8252): stdout: | (launched: 2022-12-09_19:45:29.910854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:32.242056 run osmo-stp_10.42.42.5(pid=8252): stderr: | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194530102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194530104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194530106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:32.391936 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8252): Process ended prematurely: osmo-stp_10.42.42.5(pid=8252) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8252)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:45:32.401641 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 19:45:32.429255 run osmo-hlr_10.42.42.2(pid=8249): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8249)] 19:45:32.478048 run osmo-hlr_10.42.42.2(pid=8249): stdout: | (launched: 2022-12-09_19:45:28.885383) 19:45:32.527226 run osmo-hlr_10.42.42.2(pid=8249): stderr: | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194529084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194529097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194529106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194529106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194529106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:32.596047 run osmo-msc_10.42.42.6(pid=8255): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8255)] 19:45:32.643401 run osmo-msc_10.42.42.6(pid=8255): stdout: | (launched: 2022-12-09_19:45:30.975907) 19:45:32.692407 run osmo-msc_10.42.42.6(pid=8255): stderr: | [0;m[38;5;43m20221209194531594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194531594 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e257a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194531594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194531594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194531594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194531595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194531596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194531605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194531605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194531605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:32.741903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8248): Terminating (SIGTERM) 19:45:32.781353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8251): Terminating (SIGTERM) 19:45:32.820641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8254): Terminating (SIGTERM) 19:45:32.860236 --- ParallelTerminationStrategy: PID 8248 died... 19:45:32.879261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8248): Terminated: ok {rc=0} 19:45:32.923115 --- ParallelTerminationStrategy: PID 8251 died... 19:45:32.941816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8251): Terminated: ok {rc=0} 19:45:32.985409 --- ParallelTerminationStrategy: PID 8254 died... 19:45:33.003850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8254): Terminated: ok {rc=0} 19:45:33.086886 bus /sierra_3: Setting Powered False 19:45:34.185483 bus /sierra_3: Setting Powered False 19:45:35.299834 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:45:36.442382 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:36.454404 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:45:36.521892 tst mo_mt_call_osmux.py: using LAC 23299 19:45:36.643214 tst mo_mt_call_osmux.py: using RAC 94 19:45:36.764882 tst mo_mt_call_osmux.py: using CellId 23299 19:45:36.887142 tst mo_mt_call_osmux.py: using BVCI 23300 19:45:36.999517 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:37.010726 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:37.021841 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:37.032811 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:37.043879 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:45:37.054848 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:45:37.168657 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:45:37.289757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:37.802581 run create_hlr_db(pid=8257): Launched 19:45:37.929793 bus /sierra_2: Setting Powered False 19:45:38.994749 run create_hlr_db(pid=8257): Terminated: ok {rc=0} 19:45:39.452190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Launched 19:45:39.781493 run osmo-hlr_10.42.42.2(pid=8260): Launched 19:45:39.907472 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:40.476546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Launched 19:45:40.806179 run osmo-stp_10.42.42.5(pid=8263): Launched 19:45:40.933691 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:41.528640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8265): Launched 19:45:41.859935 run osmo-msc_10.42.42.6(pid=8266): Launched 19:45:42.044483 run osmo-stp_10.42.42.5(pid=8263): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] 19:45:42.182681 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-09_19:45:40.746039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:42.321731 run osmo-stp_10.42.42.5(pid=8263): stderr: | [0;m[38;5;43m20221209194540939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194540939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194540940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194540940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:42.459345 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-09_19:45:40.746039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:42.590696 run osmo-stp_10.42.42.5(pid=8263): stderr: | [0;m[38;5;43m20221209194540939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194540939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194540940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194540940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194540941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:42.748148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:45:42.758152 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:45:42.786492 run osmo-hlr_10.42.42.2(pid=8260): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8260)] 19:45:42.836076 run osmo-hlr_10.42.42.2(pid=8260): stdout: | (launched: 2022-12-09_19:45:39.721378) 19:45:42.887408 run osmo-hlr_10.42.42.2(pid=8260): stderr: | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194539921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194539933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194539942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194539942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194539942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:42.959097 run osmo-msc_10.42.42.6(pid=8266): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8266)] 19:45:43.008642 run osmo-msc_10.42.42.6(pid=8266): stdout: | (launched: 2022-12-09_19:45:41.799628) 19:45:43.059948 run osmo-msc_10.42.42.6(pid=8266): stderr: | [0;m[38;5;43m20221209194542122 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194542122 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc34983cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194542122 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194542122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194542123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194542123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194542124 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194542125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194542125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194542125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:43.111511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminating (SIGTERM) 19:45:43.153160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminating (SIGTERM) 19:45:43.194821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8265): Terminating (SIGTERM) 19:45:43.236757 --- ParallelTerminationStrategy: PID 8259 died... 19:45:43.256690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminated: ok {rc=0} 19:45:43.303123 --- ParallelTerminationStrategy: PID 8262 died... 19:45:43.322781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminated: ok {rc=0} 19:45:43.368812 --- ParallelTerminationStrategy: PID 8265 died... 19:45:43.388634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8265): Terminated: ok {rc=0} 19:45:43.476181 bus /sierra_3: Setting Powered False 19:45:44.574047 bus /sierra_3: Setting Powered False 19:45:45.689525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:45:46.947089 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:46.961143 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:45:46.994399 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:45:47.021972 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:45:47.073595 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:45:47.110682 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:45:47.140373 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:45:47.683107 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:45:47.733305 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:47.744636 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:45:47.811937 tst mo_mt_call.py: using LAC 23300 19:45:47.934323 tst mo_mt_call.py: using RAC 95 19:45:48.056132 tst mo_mt_call.py: using CellId 23300 19:45:48.175889 tst mo_mt_call.py: using BVCI 23301 19:45:48.297378 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:48.309239 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:48.320927 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:48.334265 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:48.346682 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:48.358388 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:48.478774 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:48.598726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:49.074744 run create_hlr_db(pid=8271): Launched 19:45:49.201207 bus /sierra_2: Setting Powered False 19:45:50.262617 run create_hlr_db(pid=8271): Terminated: ok {rc=0} 19:45:50.711034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Launched 19:45:51.040810 run osmo-hlr_10.42.42.2(pid=8274): Launched 19:45:51.166115 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:51.732822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Launched 19:45:52.062091 run osmo-stp_10.42.42.5(pid=8277): Launched 19:45:52.188434 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:52.751719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Launched 19:45:53.059222 run osmo-msc_10.42.42.6(pid=8280): Launched 19:45:53.229334 run osmo-stp_10.42.42.5(pid=8277): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] 19:45:53.357957 run osmo-stp_10.42.42.5(pid=8277): stdout: | (launched: 2022-12-09_19:45:52.001950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:53.486866 run osmo-stp_10.42.42.5(pid=8277): stderr: | [0;m[38;5;43m20221209194552197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194552198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194552198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194552198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:53.613451 run osmo-stp_10.42.42.5(pid=8277): stdout: | (launched: 2022-12-09_19:45:52.001950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:53.734844 run osmo-stp_10.42.42.5(pid=8277): stderr: | [0;m[38;5;43m20221209194552197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194552198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194552198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194552198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194552199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:53.880912 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8277): Process ended prematurely: osmo-stp_10.42.42.5(pid=8277) [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:45:53.890152 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:45:53.916376 run osmo-hlr_10.42.42.2(pid=8274): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8274)] 19:45:53.963292 run osmo-hlr_10.42.42.2(pid=8274): stdout: | (launched: 2022-12-09_19:45:50.980840) 19:45:54.011931 run osmo-hlr_10.42.42.2(pid=8274): stderr: | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194551182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194551194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194551202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194551202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194551202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:54.079931 run osmo-msc_10.42.42.6(pid=8280): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8280)] 19:45:54.127007 run osmo-msc_10.42.42.6(pid=8280): stdout: | (launched: 2022-12-09_19:45:53.002766) 19:45:54.175531 run osmo-msc_10.42.42.6(pid=8280): stderr: | [0;m[38;5;43m20221209194553277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194553277 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab4dc99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194553277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194553277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194553277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194553278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194553279 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194553280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194553280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194553280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:54.224238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Terminating (SIGTERM) 19:45:54.263224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Terminating (SIGTERM) 19:45:54.302236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Terminating (SIGTERM) 19:45:54.341493 --- ParallelTerminationStrategy: PID 8273 died... 19:45:54.360227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Terminated: ok {rc=0} 19:45:54.404206 --- ParallelTerminationStrategy: PID 8276 died... 19:45:54.422888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Terminated: ok {rc=0} 19:45:54.466496 --- ParallelTerminationStrategy: PID 8279 died... 19:45:54.484643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Terminated: ok {rc=0} 19:45:54.567320 bus /sierra_3: Setting Powered False 19:45:55.664765 bus /sierra_3: Setting Powered False 19:45:56.781961 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:45:57.927309 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:57.939118 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:45:58.005729 tst mo_mt_call_osmux.py: using LAC 23301 19:45:58.125980 tst mo_mt_call_osmux.py: using RAC 96 19:45:58.245647 tst mo_mt_call_osmux.py: using CellId 23301 19:45:58.366052 tst mo_mt_call_osmux.py: using BVCI 23302 19:45:58.476688 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:58.487937 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:58.498965 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:58.509949 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:58.521250 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:45:58.532157 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:58.647213 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:58.763712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:59.241786 run create_hlr_db(pid=8282): Launched 19:45:59.366318 bus /sierra_2: Setting Powered False 19:46:00.427370 run create_hlr_db(pid=8282): Terminated: ok {rc=0} 19:46:00.906637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8284): Launched 19:46:01.225070 run osmo-hlr_10.42.42.2(pid=8285): Launched 19:46:01.488909 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:02.221399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8287): Launched 19:46:02.588243 run osmo-stp_10.42.42.5(pid=8288): Launched 19:46:02.715026 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:03.310380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Launched 19:46:03.641031 run osmo-msc_10.42.42.6(pid=8291): Launched 19:46:03.824042 run osmo-stp_10.42.42.5(pid=8288): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8288)] 19:46:03.962188 run osmo-stp_10.42.42.5(pid=8288): stdout: | (launched: 2022-12-09_19:46:02.528193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:04.100650 run osmo-stp_10.42.42.5(pid=8288): stderr: | [0;m[38;5;43m20221209194602719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194602719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194602720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194602720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194602722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194602723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194602723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:04.237702 run osmo-stp_10.42.42.5(pid=8288): stdout: | (launched: 2022-12-09_19:46:02.528193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:04.368594 run osmo-stp_10.42.42.5(pid=8288): stderr: | [0;m[38;5;43m20221209194602719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194602719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194602720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194602720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194602722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194602723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194602723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:04.525125 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8288): Process ended prematurely: osmo-stp_10.42.42.5(pid=8288) [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8288)] [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:46:04.534938 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:46:04.564041 run osmo-hlr_10.42.42.2(pid=8285): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8285)] 19:46:04.614216 run osmo-hlr_10.42.42.2(pid=8285): stdout: | (launched: 2022-12-09_19:46:01.167829) 19:46:04.666025 run osmo-hlr_10.42.42.2(pid=8285): stderr: | [0;m[1;31m20221209194601410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194601410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194601410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194601410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194601410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194601411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194601429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194601442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194601442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194601442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:04.738570 run osmo-msc_10.42.42.6(pid=8291): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8291)] 19:46:04.788807 run osmo-msc_10.42.42.6(pid=8291): stdout: | (launched: 2022-12-09_19:46:03.580848) 19:46:04.840637 run osmo-msc_10.42.42.6(pid=8291): stderr: | [0;m[38;5;43m20221209194603906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194603906 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c07256c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194603906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194603906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194603907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194603907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194603908 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194603909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194603909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194603909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:04.893000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8284): Terminating (SIGTERM) 19:46:04.934676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8287): Terminating (SIGTERM) 19:46:04.976481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Terminating (SIGTERM) 19:46:05.018717 --- ParallelTerminationStrategy: PID 8284 died... 19:46:05.038659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8284): Terminated: ok {rc=0} 19:46:05.085474 --- ParallelTerminationStrategy: PID 8287 died... 19:46:05.104867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8287): Terminated: ok {rc=0} 19:46:05.151355 --- ParallelTerminationStrategy: PID 8290 died... 19:46:05.171017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Terminated: ok {rc=0} 19:46:05.259131 bus /sierra_3: Setting Powered False 19:46:06.355828 bus /sierra_3: Setting Powered False 19:46:07.470005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:46:08.713374 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:08.720201 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:46:08.751698 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:46:08.777834 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:46:08.828435 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:46:08.860122 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:46:08.886248 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:46:09.440511 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:46:09.489394 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:09.500609 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:46:09.549812 tst mo_mt_call.py: using LAC 23302 19:46:09.670598 tst mo_mt_call.py: using RAC 97 19:46:09.791791 tst mo_mt_call.py: using CellId 23302 19:46:09.913284 tst mo_mt_call.py: using BVCI 23303 19:46:10.024311 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:10.035629 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:10.046744 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:10.057953 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:10.069180 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:10.080212 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:46:10.200648 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:46:10.321464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:10.832626 run create_hlr_db(pid=8296): Launched 19:46:10.960098 bus /sierra_2: Setting Powered False 19:46:12.026084 run create_hlr_db(pid=8296): Terminated: ok {rc=0} 19:46:12.466351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8298): Launched 19:46:12.774617 run osmo-hlr_10.42.42.2(pid=8299): Launched 19:46:12.891337 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:13.436240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8301): Launched 19:46:13.742557 run osmo-stp_10.42.42.5(pid=8302): Launched 19:46:13.862091 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:14.416735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8304): Launched 19:46:14.722694 run osmo-msc_10.42.42.6(pid=8305): Launched 19:46:14.895242 run osmo-stp_10.42.42.5(pid=8302): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8302)] 19:46:15.024769 run osmo-stp_10.42.42.5(pid=8302): stdout: | (launched: 2022-12-09_19:46:13.685958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:15.153862 run osmo-stp_10.42.42.5(pid=8302): stderr: | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194613859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:15.281235 run osmo-stp_10.42.42.5(pid=8302): stdout: | (launched: 2022-12-09_19:46:13.685958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:15.402733 run osmo-stp_10.42.42.5(pid=8302): stderr: | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194613858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194613859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194613859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:15.547900 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8302): Process ended prematurely: osmo-stp_10.42.42.5(pid=8302) [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8302)] [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:46:15.556767 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:46:15.583137 run osmo-hlr_10.42.42.2(pid=8299): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8299)] 19:46:15.629943 run osmo-hlr_10.42.42.2(pid=8299): stdout: | (launched: 2022-12-09_19:46:12.718139) 19:46:15.678526 run osmo-hlr_10.42.42.2(pid=8299): stderr: | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194612896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194612909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194612918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194612919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194612919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:15.746286 run osmo-msc_10.42.42.6(pid=8305): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8305)] 19:46:15.792908 run osmo-msc_10.42.42.6(pid=8305): stdout: | (launched: 2022-12-09_19:46:14.666108) 19:46:15.849536 run osmo-msc_10.42.42.6(pid=8305): stderr: | [0;m[38;5;43m20221209194614940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194614940 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fafaee3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194614940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194614941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194614941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194614941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194614943 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194614943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194614943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194614943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:15.905330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8298): Terminating (SIGTERM) 19:46:15.950999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8301): Terminating (SIGTERM) 19:46:15.997108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8304): Terminating (SIGTERM) 19:46:16.043412 --- ParallelTerminationStrategy: PID 8298 died... 19:46:16.064290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8298): Terminated: ok {rc=0} 19:46:16.115981 --- ParallelTerminationStrategy: PID 8301 died... 19:46:16.136570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8301): Terminated: ok {rc=0} 19:46:16.185911 --- ParallelTerminationStrategy: PID 8304 died... 19:46:16.206572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8304): Terminated: ok {rc=0} 19:46:16.303673 bus /sierra_3: Setting Powered False 19:46:17.418438 bus /sierra_3: Setting Powered False 19:46:18.533989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:46:19.683264 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:19.696016 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:46:19.751830 tst mo_mt_call_osmux.py: using LAC 23303 19:46:19.880374 tst mo_mt_call_osmux.py: using RAC 98 19:46:20.012580 tst mo_mt_call_osmux.py: using CellId 23303 19:46:20.141831 tst mo_mt_call_osmux.py: using BVCI 23304 19:46:20.262176 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:20.274238 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:20.285960 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:20.298576 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:20.311932 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:46:20.323802 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:46:20.444839 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:46:20.565447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:21.043009 run create_hlr_db(pid=8307): Launched 19:46:21.168529 bus /sierra_2: Setting Powered False 19:46:22.230570 run create_hlr_db(pid=8307): Terminated: ok {rc=0} 19:46:22.658997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Launched 19:46:22.966230 run osmo-hlr_10.42.42.2(pid=8310): Launched 19:46:23.081540 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:23.612268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Launched 19:46:23.919087 run osmo-stp_10.42.42.5(pid=8313): Launched 19:46:24.036668 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:24.591244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8315): Launched 19:46:24.898334 run osmo-msc_10.42.42.6(pid=8316): Launched 19:46:25.069447 run osmo-stp_10.42.42.5(pid=8313): ERR: Terminated: ERROR {rc=1} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] 19:46:25.199206 run osmo-stp_10.42.42.5(pid=8313): stdout: | (launched: 2022-12-09_19:46:23.862457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:25.328594 run osmo-stp_10.42.42.5(pid=8313): stderr: | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194624034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:25.456214 run osmo-stp_10.42.42.5(pid=8313): stdout: | (launched: 2022-12-09_19:46:23.862457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:25.578282 run osmo-stp_10.42.42.5(pid=8313): stderr: | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194624033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194624034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194624034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:25.724333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8313): Process ended prematurely: osmo-stp_10.42.42.5(pid=8313) [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:46:25.733343 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:46:25.759717 run osmo-hlr_10.42.42.2(pid=8310): ERR: Terminated: ERROR {rc=237} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8310)] 19:46:25.806669 run osmo-hlr_10.42.42.2(pid=8310): stdout: | (launched: 2022-12-09_19:46:22.909813) 19:46:25.854993 run osmo-hlr_10.42.42.2(pid=8310): stderr: | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194623090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194623102 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:25.922682 run osmo-msc_10.42.42.6(pid=8316): ERR: Terminated: ERROR {rc=2} [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8316)] 19:46:25.969285 run osmo-msc_10.42.42.6(pid=8316): stdout: | (launched: 2022-12-09_19:46:24.841610) 19:46:26.017296 run osmo-msc_10.42.42.6(pid=8316): stderr: | [0;m[38;5;43m20221209194625114 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194625114 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f499dbf5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194625114 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194625114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194625114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194625114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194625116 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194625116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194625117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194625117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:26.066517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Terminating (SIGTERM) 19:46:26.105572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Terminating (SIGTERM) 19:46:26.144586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8315): Terminating (SIGTERM) 19:46:26.184344 --- ParallelTerminationStrategy: PID 8309 died... 19:46:26.203157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Terminated: ok {rc=0} 19:46:26.246346 --- ParallelTerminationStrategy: PID 8312 died... 19:46:26.264650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Terminated: ok {rc=0} 19:46:26.307816 --- ParallelTerminationStrategy: PID 8315 died... 19:46:26.326063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8315): Terminated: ok {rc=0} 19:46:26.410718 bus /sierra_3: Setting Powered False 19:46:27.508712 bus /sierra_3: Setting Powered False 19:46:28.619703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 emergency:nanobts+band-900 --------------------------------------------------------------------- 19:46:29.868344 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:29.873501 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:46:29.904774 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:46:29.930704 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 19:46:30.014124 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:46:30.045450 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:46:30.071545 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 19:46:30.655574 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2363 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 19:46:30.660562 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:30.671206 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 19:46:30.717754 tst emergency_mo_mt_call.py: using LAC 23304 19:46:30.849299 tst emergency_mo_mt_call.py: using RAC 99 19:46:31.003029 tst emergency_mo_mt_call.py: using CellId 23304 19:46:31.128670 tst emergency_mo_mt_call.py: using BVCI 23305 19:46:31.250684 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:31.263161 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:31.275295 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:31.287353 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:31.299610 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:31.312938 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:31.440516 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:31.566157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:32.064201 run create_hlr_db(pid=8321): Launched 19:46:32.219232 bus /sierra_2: Setting Powered False 19:46:33.279587 run create_hlr_db(pid=8321): Terminated: ok {rc=0} 19:46:33.700741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8323): Launched 19:46:34.002391 run osmo-hlr_10.42.42.2(pid=8324): Launched 19:46:34.116526 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:34.649530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8326): Launched 19:46:34.950600 run osmo-stp_10.42.42.5(pid=8327): Launched 19:46:35.073996 tst emergency_mo_mt_call.py: using MSISDN 7343 19:46:35.226595 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:35.770807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8329): Launched 19:46:36.072551 run osmo-msc_10.42.42.6(pid=8330): Launched 19:46:36.242686 run osmo-stp_10.42.42.5(pid=8327): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8327)] 19:46:36.370479 run osmo-stp_10.42.42.5(pid=8327): stdout: | (launched: 2022-12-09_19:46:34.894794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:36.497814 run osmo-stp_10.42.42.5(pid=8327): stderr: | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194635065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:36.622447 run osmo-stp_10.42.42.5(pid=8327): stdout: | (launched: 2022-12-09_19:46:34.894794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:36.742395 run osmo-stp_10.42.42.5(pid=8327): stderr: | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194635064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194635065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194635065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:36.885849 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8327): Process ended prematurely: osmo-stp_10.42.42.5(pid=8327) [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8327)] [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 19:46:36.894073 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 19:46:36.919815 run osmo-hlr_10.42.42.2(pid=8324): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8324)] 19:46:36.966692 run osmo-hlr_10.42.42.2(pid=8324): stdout: | (launched: 2022-12-09_19:46:33.946707) 19:46:37.015326 run osmo-hlr_10.42.42.2(pid=8324): stderr: | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194634125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194634137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194634146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194634146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194634146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:37.083713 run osmo-msc_10.42.42.6(pid=8330): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8330)] 19:46:37.131107 run osmo-msc_10.42.42.6(pid=8330): stdout: | (launched: 2022-12-09_19:46:36.015803) 19:46:37.179508 run osmo-msc_10.42.42.6(pid=8330): stderr: | [0;m[38;5;43m20221209194636286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194636286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8831170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194636286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194636286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194636286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194636287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194636288 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194636289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194636289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194636289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:37.228272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8323): Terminating (SIGTERM) 19:46:37.267406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8326): Terminating (SIGTERM) 19:46:37.306406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8329): Terminating (SIGTERM) 19:46:37.345594 --- ParallelTerminationStrategy: PID 8323 died... 19:46:37.363982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8323): Terminated: ok {rc=0} 19:46:37.407190 --- ParallelTerminationStrategy: PID 8326 died... 19:46:37.425463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8326): Terminated: ok {rc=0} 19:46:37.468498 --- ParallelTerminationStrategy: PID 8329 died... 19:46:37.486880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8329): Terminated: ok {rc=0} 19:46:37.571228 bus /sierra_3: Setting Powered False 19:46:38.669440 bus /sierra_3: Setting Powered False 19:46:39.783442 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 19:46:40.870989 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:40.883075 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 19:46:40.935597 tst emergency_preemptive_call.py: using LAC 23305 19:46:41.064340 tst emergency_preemptive_call.py: using RAC 100 19:46:41.191997 tst emergency_preemptive_call.py: using CellId 23305 19:46:41.320269 tst emergency_preemptive_call.py: using BVCI 23306 19:46:41.439136 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:41.450754 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:41.462079 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:41.473939 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:41.485326 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:46:41.496562 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:41.611619 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:41.729725 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:41.849575 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:41.963802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:42.437244 run create_hlr_db(pid=8332): Launched 19:46:42.561792 bus /sierra_2: Setting Powered False 19:46:43.622101 run create_hlr_db(pid=8332): Terminated: ok {rc=0} 19:46:44.066079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8334): Launched 19:46:44.392694 run osmo-hlr_10.42.42.2(pid=8335): Launched 19:46:44.517399 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:45.077651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8337): Launched 19:46:45.402884 run osmo-stp_10.42.42.5(pid=8338): Launched 19:46:45.537786 tst emergency_preemptive_call.py: using MSISDN 7344 19:46:45.707562 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:46.294182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8340): Launched 19:46:46.635012 run osmo-msc_10.42.42.6(pid=8341): Launched 19:46:47.037787 run osmo-stp_10.42.42.5(pid=8338): ERR: Terminated: ERROR {rc=1} [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8338)] 19:46:47.311068 run osmo-stp_10.42.42.5(pid=8338): stdout: | (launched: 2022-12-09_19:46:45.343556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:47.448886 run osmo-stp_10.42.42.5(pid=8338): stderr: | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194645539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:47.585920 run osmo-stp_10.42.42.5(pid=8338): stdout: | (launched: 2022-12-09_19:46:45.343556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:47.716629 run osmo-stp_10.42.42.5(pid=8338): stderr: | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194645538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194645539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194645539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:47.872445 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8338): Process ended prematurely: osmo-stp_10.42.42.5(pid=8338) [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8338)] [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 19:46:47.881776 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 19:46:47.910967 run osmo-hlr_10.42.42.2(pid=8335): ERR: Terminated: ERROR {rc=237} [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8335)] 19:46:47.962024 run osmo-hlr_10.42.42.2(pid=8335): stdout: | (launched: 2022-12-09_19:46:44.333283) 19:46:48.014422 run osmo-hlr_10.42.42.2(pid=8335): stderr: | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194644532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194644544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194644553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194644553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194644553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:48.087040 run osmo-msc_10.42.42.6(pid=8341): ERR: Terminated: ERROR {rc=2} [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8341)] 19:46:48.137692 run osmo-msc_10.42.42.6(pid=8341): stdout: | (launched: 2022-12-09_19:46:46.574602) 19:46:48.189478 run osmo-msc_10.42.42.6(pid=8341): stderr: | [0;m[38;5;43m20221209194647244 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209194647244 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f0fe74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209194647244 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209194647245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209194647245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209194647245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209194647247 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209194647247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209194647247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209194647247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:48.241793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8334): Terminating (SIGTERM) 19:46:48.283538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8337): Terminating (SIGTERM) 19:46:48.325486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8340): Terminating (SIGTERM) 19:46:48.367609 --- ParallelTerminationStrategy: PID 8334 died... 19:46:48.387705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8334): Terminated: ok {rc=0} 19:46:48.434592 --- ParallelTerminationStrategy: PID 8337 died... 19:46:48.454456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8337): Terminated: ok {rc=0} 19:46:48.501482 --- ParallelTerminationStrategy: PID 8340 died... 19:46:48.521364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8340): Terminated: ok {rc=0} 19:46:48.610155 bus /sierra_9: Setting Powered False 19:46:49.709158 bus /sierra_9: Setting Powered False 19:46:50.823482 bus /sierra_8: Setting Powered False 19:46:51.920538 bus /sierra_8: Setting Powered False 19:46:53.035483 bus /sierra_3: Setting Powered False 19:46:54.134216 bus /sierra_3: Setting Powered False 19:46:55.250533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900 --------------------------------------------------------------------- 19:46:56.532929 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:56.538820 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:46:56.573087 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 19:46:56.612698 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 19:46:56.700156 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:46:56.732909 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 19:46:56.771648 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 19:46:57.366702 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 19:46:57.421886 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:57.433134 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:46:57.480038 tst cs_paging_gprs_active.py: using LAC 23306 19:46:57.607042 tst cs_paging_gprs_active.py: using RAC 101 19:46:57.734511 tst cs_paging_gprs_active.py: using CellId 23306 19:46:57.861801 tst cs_paging_gprs_active.py: using BVCI 23307 19:46:57.983793 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:57.995012 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.006028 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.017525 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.028742 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.040016 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.051425 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.062952 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:46:58.074736 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:58.194199 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:46:58.312091 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:46:58.520405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:46:58.830912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8346): Launched 19:46:59.098698 run iperf3-srv_10.42.42.10(pid=8347): Launched 19:46:59.213803 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:46:59.420801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:46:59.730745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Launched 19:46:59.998362 run iperf3-srv_10.42.42.10(pid=8349): Launched 19:47:00.113180 tst cs_paging_gprs_active.py:38: start network... 19:47:00.320150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:00.798482 run create_hlr_db(pid=8350): Launched 19:47:00.957368 bus /sierra_2: Setting Powered False 19:47:02.024741 run create_hlr_db(pid=8350): Terminated: ok {rc=0} 19:47:02.493557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8352): Launched 19:47:02.825767 run osmo-hlr_10.42.42.2(pid=8353): Launched 19:47:02.954530 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:03.519893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8355): Launched 19:47:03.852032 run osmo-stp_10.42.42.5(pid=8356): Launched 19:47:03.979030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:47:04.547795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8358): Launched 19:47:04.675183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:47:04.955192 run patchelf(pid=8359): Launched 19:47:05.139617 run osmo-stp_10.42.42.5(pid=8356): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8356)] 19:47:05.279302 run osmo-stp_10.42.42.5(pid=8356): stdout: | (launched: 2022-12-09_19:47:03.791667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:05.420134 run osmo-stp_10.42.42.5(pid=8356): stderr: | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194703988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:05.560527 run osmo-stp_10.42.42.5(pid=8356): stdout: | (launched: 2022-12-09_19:47:03.791667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:05.695329 run osmo-stp_10.42.42.5(pid=8356): stderr: | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194703987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194703988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194703988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:05.855737 run patchelf(pid=8359): Terminating (SIGINT) 19:47:06.040044 run patchelf(pid=8359): Terminated: ok {rc=0} 19:47:06.173698 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8356): Process ended prematurely: osmo-stp_10.42.42.5(pid=8356) [trial-2363↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8356)] [trial-2363↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 19:47:06.184238 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:47:06.213601 run osmo-hlr_10.42.42.2(pid=8353): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8353)] 19:47:06.263496 run osmo-hlr_10.42.42.2(pid=8353): stdout: | (launched: 2022-12-09_19:47:02.765630) 19:47:06.315054 run osmo-hlr_10.42.42.2(pid=8353): stderr: | [0;m[1;31m20221209194702965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194702965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194702965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194702965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194702965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194702966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194702978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194702986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194702987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194702987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:06.367251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8346): Terminating (SIGTERM) 19:47:06.408821 run iperf3-srv_10.42.42.10(pid=8347): Terminating (SIGTERM) 19:47:06.453715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Terminating (SIGTERM) 19:47:06.493616 run iperf3-srv_10.42.42.10(pid=8349): Terminating (SIGTERM) 19:47:06.533180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8352): Terminating (SIGTERM) 19:47:06.572826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8355): Terminating (SIGTERM) 19:47:06.612490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8358): Terminating (SIGTERM) 19:47:06.652717 --- ParallelTerminationStrategy: PID 8346 died... 19:47:06.671810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8346): Terminated: ok {rc=0} 19:47:06.716684 --- ParallelTerminationStrategy: PID 8347 died... 19:47:06.735244 run iperf3-srv_10.42.42.10(pid=8347): Terminated {rc=256} 19:47:06.779443 --- ParallelTerminationStrategy: PID 8348 died... 19:47:06.797998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Terminated: ok {rc=0} 19:47:06.842350 --- ParallelTerminationStrategy: PID 8349 died... 19:47:06.861213 run iperf3-srv_10.42.42.10(pid=8349): Terminated {rc=256} 19:47:06.905533 --- ParallelTerminationStrategy: PID 8352 died... 19:47:06.923907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8352): Terminated: ok {rc=0} 19:47:06.968729 --- ParallelTerminationStrategy: PID 8355 died... 19:47:06.987480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8355): Terminated: ok {rc=0} 19:47:07.032070 --- ParallelTerminationStrategy: PID 8358 died... 19:47:07.050844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8358): Terminated: ok {rc=0} 19:47:07.136447 bus /gobi_0: Setting Powered False 19:47:08.236328 bus /gobi_0: Setting Powered False 19:47:09.351361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 19:47:10.497450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:10.508770 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:10.558452 tst iperf3.py: using LAC 23307 19:47:10.678241 tst iperf3.py: using RAC 102 19:47:10.799822 tst iperf3.py: using CellId 23307 19:47:10.921151 tst iperf3.py: using BVCI 23308 19:47:11.032005 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.042761 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.053221 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.063569 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.073930 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.084359 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.094948 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.105253 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:11.115740 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:11.230761 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:47:11.438389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:11.748027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Launched 19:47:12.016326 run iperf3-srv_10.42.42.10(pid=8361): Launched 19:47:12.131280 tst iperf3.py:8: start network... 19:47:12.337935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:12.816831 run create_hlr_db(pid=8362): Launched 19:47:12.941830 bus /gobi_6: Setting Powered False 19:47:14.003356 run create_hlr_db(pid=8362): Terminated: ok {rc=0} 19:47:14.451777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8364): Launched 19:47:14.783526 run osmo-hlr_10.42.42.2(pid=8365): Launched 19:47:14.909075 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:15.478489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8367): Launched 19:47:15.811453 run osmo-stp_10.42.42.5(pid=8368): Launched 19:47:16.030662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:47:16.793725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8370): Launched 19:47:16.931339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:47:17.217649 run patchelf(pid=8371): Launched 19:47:17.408609 run osmo-stp_10.42.42.5(pid=8368): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8368)] 19:47:17.539650 run osmo-stp_10.42.42.5(pid=8368): stdout: | (launched: 2022-12-09_19:47:15.751225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:17.671569 run osmo-stp_10.42.42.5(pid=8368): stderr: | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194716061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:17.803615 run osmo-stp_10.42.42.5(pid=8368): stdout: | (launched: 2022-12-09_19:47:15.751225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:17.929798 run osmo-stp_10.42.42.5(pid=8368): stderr: | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194716060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194716061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194716068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:18.079289 run patchelf(pid=8371): Terminating (SIGINT) 19:47:18.251635 run patchelf(pid=8371): Terminated: ok {rc=0} 19:47:18.376026 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8368): Process ended prematurely: osmo-stp_10.42.42.5(pid=8368) [trial-2363↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8368)] [trial-2363↪gprs:nanobts+band-900↪iperf3.py:8] 19:47:18.385828 tst iperf3.py:8: Test FAILED (7.9 sec) 19:47:18.412827 run osmo-hlr_10.42.42.2(pid=8365): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8365)] 19:47:18.460694 run osmo-hlr_10.42.42.2(pid=8365): stdout: | (launched: 2022-12-09_19:47:14.723069) 19:47:18.509615 run osmo-hlr_10.42.42.2(pid=8365): stderr: | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194714925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194714938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194714946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194714946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194714946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:18.558833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Terminating (SIGTERM) 19:47:18.598361 run iperf3-srv_10.42.42.10(pid=8361): Terminating (SIGTERM) 19:47:18.637756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8364): Terminating (SIGTERM) 19:47:18.677177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8367): Terminating (SIGTERM) 19:47:18.716521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8370): Terminating (SIGTERM) 19:47:18.756142 --- ParallelTerminationStrategy: PID 8360 died... 19:47:18.775146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Terminated: ok {rc=0} 19:47:18.819107 --- ParallelTerminationStrategy: PID 8361 died... 19:47:18.837775 run iperf3-srv_10.42.42.10(pid=8361): Terminated {rc=256} 19:47:18.881301 --- ParallelTerminationStrategy: PID 8364 died... 19:47:18.899819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8364): Terminated: ok {rc=0} 19:47:18.944019 --- ParallelTerminationStrategy: PID 8367 died... 19:47:18.962737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8367): Terminated: ok {rc=0} 19:47:19.006539 --- ParallelTerminationStrategy: PID 8370 died... 19:47:19.025228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8370): Terminated: ok {rc=0} 19:47:19.108332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 19:47:20.258413 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.270437 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:20.319918 tst iperf3m4.py: using LAC 23308 19:47:20.450399 tst iperf3m4.py: using RAC 103 19:47:20.579896 tst iperf3m4.py: using CellId 23308 19:47:20.705107 tst iperf3m4.py: using BVCI 23309 19:47:20.818448 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.829516 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.840098 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.850852 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.861563 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.872107 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.882772 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.893240 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:20.903847 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:21.023121 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:21.143947 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:21.263945 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:21.385279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:47:21.609715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:21.942604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8372): Launched 19:47:22.229569 run iperf3-srv_10.42.42.10(pid=8373): Launched 19:47:22.352929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:47:22.576593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:22.909895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Launched 19:47:23.198173 run iperf3-srv_10.42.42.10(pid=8375): Launched 19:47:23.323592 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:47:23.546805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:23.879160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Launched 19:47:24.166749 run iperf3-srv_10.42.42.10(pid=8377): Launched 19:47:24.291335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:47:24.514155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:24.846797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Launched 19:47:25.134761 run iperf3-srv_10.42.42.10(pid=8379): Launched 19:47:25.259714 tst iperf3m4.py:8: start network... 19:47:25.483384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:25.996568 run create_hlr_db(pid=8380): Launched 19:47:26.124105 bus /gobi_6: Setting Powered False 19:47:27.188411 run create_hlr_db(pid=8380): Terminated: ok {rc=0} 19:47:27.647204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Launched 19:47:27.978473 run osmo-hlr_10.42.42.2(pid=8383): Launched 19:47:28.106531 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:28.676289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8385): Launched 19:47:29.008784 run osmo-stp_10.42.42.5(pid=8386): Launched 19:47:29.135735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:47:29.705471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8388): Launched 19:47:29.833862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:47:30.113773 run patchelf(pid=8389): Launched 19:47:30.297386 run osmo-stp_10.42.42.5(pid=8386): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8386)] 19:47:30.437055 run osmo-stp_10.42.42.5(pid=8386): stdout: | (launched: 2022-12-09_19:47:28.948162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:30.578553 run osmo-stp_10.42.42.5(pid=8386): stderr: | [0;m[38;5;43m20221209194729140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194729140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194729141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194729141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:30.720304 run osmo-stp_10.42.42.5(pid=8386): stdout: | (launched: 2022-12-09_19:47:28.948162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:30.882513 run osmo-stp_10.42.42.5(pid=8386): stderr: | [0;m[38;5;43m20221209194729140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194729140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194729141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194729141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194729142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:31.055889 run patchelf(pid=8389): Terminating (SIGINT) 19:47:31.244508 run patchelf(pid=8389): Terminated: ok {rc=0} 19:47:31.381371 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8386): Process ended prematurely: osmo-stp_10.42.42.5(pid=8386) [trial-2363↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8386)] [trial-2363↪gprs:nanobts+band-900↪iperf3m4.py:8] 19:47:31.392787 tst iperf3m4.py:8: Test FAILED (11.2 sec) 19:47:31.425310 run osmo-hlr_10.42.42.2(pid=8383): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8383)] 19:47:31.477487 run osmo-hlr_10.42.42.2(pid=8383): stdout: | (launched: 2022-12-09_19:47:27.917761) 19:47:31.531526 run osmo-hlr_10.42.42.2(pid=8383): stderr: | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194728116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194728128 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194728137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194728137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194728137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:31.594667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8372): Terminating (SIGTERM) 19:47:31.646119 run iperf3-srv_10.42.42.10(pid=8373): Terminating (SIGTERM) 19:47:31.706143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Terminating (SIGTERM) 19:47:31.761502 run iperf3-srv_10.42.42.10(pid=8375): Terminating (SIGTERM) 19:47:31.815482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Terminating (SIGTERM) 19:47:31.864013 run iperf3-srv_10.42.42.10(pid=8377): Terminating (SIGTERM) 19:47:31.921438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminating (SIGTERM) 19:47:31.972822 run iperf3-srv_10.42.42.10(pid=8379): Terminating (SIGTERM) 19:47:32.027963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Terminating (SIGTERM) 19:47:32.078070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8385): Terminating (SIGTERM) 19:47:32.130137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8388): Terminating (SIGTERM) 19:47:32.173379 --- ParallelTerminationStrategy: PID 8372 died... 19:47:32.192800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8372): Terminated: ok {rc=0} 19:47:32.239262 --- ParallelTerminationStrategy: PID 8373 died... 19:47:32.257863 run iperf3-srv_10.42.42.10(pid=8373): Terminated {rc=256} 19:47:32.301268 --- ParallelTerminationStrategy: PID 8374 died... 19:47:32.319868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Terminated: ok {rc=0} 19:47:32.363837 --- ParallelTerminationStrategy: PID 8375 died... 19:47:32.382478 run iperf3-srv_10.42.42.10(pid=8375): Terminated {rc=256} 19:47:32.425921 --- ParallelTerminationStrategy: PID 8376 died... 19:47:32.444474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Terminated: ok {rc=0} 19:47:32.488018 --- ParallelTerminationStrategy: PID 8377 died... 19:47:32.506491 run iperf3-srv_10.42.42.10(pid=8377): Terminated {rc=256} 19:47:32.549852 --- ParallelTerminationStrategy: PID 8378 died... 19:47:32.568835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminated: ok {rc=0} 19:47:32.612454 --- ParallelTerminationStrategy: PID 8379 died... 19:47:32.630877 run iperf3-srv_10.42.42.10(pid=8379): Terminated {rc=256} 19:47:32.674288 --- ParallelTerminationStrategy: PID 8382 died... 19:47:32.692752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Terminated: ok {rc=0} 19:47:32.736775 --- ParallelTerminationStrategy: PID 8385 died... 19:47:32.755475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8385): Terminated: ok {rc=0} 19:47:32.799282 --- ParallelTerminationStrategy: PID 8388 died... 19:47:32.818210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8388): Terminated: ok {rc=0} 19:47:32.904002 bus /gobi_4: Setting Powered False 19:47:34.003240 bus /gobi_4: Setting Powered False 19:47:35.117807 bus /gobi_1: Setting Powered False 19:47:36.216333 bus /gobi_1: Setting Powered False 19:47:37.331189 bus /gobi_0: Setting Powered False 19:47:38.430325 bus /gobi_0: Setting Powered False 19:47:39.546276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900 ping.py ---------------------------------------------- 19:47:40.649275 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:40.660449 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:40.708139 tst ping.py: using LAC 23309 19:47:40.829052 tst ping.py: using RAC 104 19:47:40.948725 tst ping.py: using CellId 23309 19:47:41.070760 tst ping.py: using BVCI 23310 19:47:41.181304 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.191953 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.202535 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.213045 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.223406 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.233874 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.244337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:41.255251 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:41.372581 tst ping.py:19: start network... 19:47:41.593419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:42.095721 run create_hlr_db(pid=8391): Launched 19:47:42.220638 bus /gobi_6: Setting Powered False 19:47:43.284820 run create_hlr_db(pid=8391): Terminated: ok {rc=0} 19:47:43.717499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8393): Launched 19:47:44.020233 run osmo-hlr_10.42.42.2(pid=8394): Launched 19:47:44.135116 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:44.657210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8396): Launched 19:47:44.959876 run osmo-stp_10.42.42.5(pid=8397): Launched 19:47:45.074774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:47:45.595282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8399): Launched 19:47:45.709955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:47:45.995372 run patchelf(pid=8400): Launched 19:47:46.180723 run osmo-stp_10.42.42.5(pid=8397): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8397)] 19:47:46.311482 run osmo-stp_10.42.42.5(pid=8397): stdout: | (launched: 2022-12-09_19:47:44.904001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:46.443248 run osmo-stp_10.42.42.5(pid=8397): stderr: | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194745076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:46.574600 run osmo-stp_10.42.42.5(pid=8397): stdout: | (launched: 2022-12-09_19:47:44.904001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:46.701860 run osmo-stp_10.42.42.5(pid=8397): stderr: | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194745075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194745076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194745076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:46.851287 run patchelf(pid=8400): Terminating (SIGINT) 19:47:47.023773 run patchelf(pid=8400): Terminated: ok {rc=0} 19:47:47.147628 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8397): Process ended prematurely: osmo-stp_10.42.42.5(pid=8397) [trial-2363↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8397)] [trial-2363↪gprs:nanobts+band-900↪ping.py:22] 19:47:47.157210 tst ping.py:22: Test FAILED (6.5 sec) 19:47:47.186121 run osmo-hlr_10.42.42.2(pid=8394): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8394)] 19:47:47.237402 run osmo-hlr_10.42.42.2(pid=8394): stdout: | (launched: 2022-12-09_19:47:43.964307) 19:47:47.286037 run osmo-hlr_10.42.42.2(pid=8394): stderr: | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194744143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194744155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194744164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194744164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194744165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:47.334957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8393): Terminating (SIGTERM) 19:47:47.374849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8396): Terminating (SIGTERM) 19:47:47.414030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8399): Terminating (SIGTERM) 19:47:47.453436 --- ParallelTerminationStrategy: PID 8393 died... 19:47:47.472120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8393): Terminated: ok {rc=0} 19:47:47.516382 --- ParallelTerminationStrategy: PID 8396 died... 19:47:47.534972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8396): Terminated: ok {rc=0} 19:47:47.578190 --- ParallelTerminationStrategy: PID 8399 died... 19:47:47.596627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8399): Terminated: ok {rc=0} 19:47:47.680864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 19:47:48.769402 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:48.781333 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:48.833382 tst ping_idle_ping.py: using LAC 23310 19:47:48.951969 tst ping_idle_ping.py: using RAC 105 19:47:49.068723 tst ping_idle_ping.py: using CellId 23310 19:47:49.185419 tst ping_idle_ping.py: using BVCI 23311 19:47:49.296870 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.307578 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.318229 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.328695 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.339105 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.349518 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.360001 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:47:49.370601 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:49.489437 tst ping_idle_ping.py:24: start network... 19:47:49.710887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:50.219106 run create_hlr_db(pid=8401): Launched 19:47:50.346057 bus /gobi_6: Setting Powered False 19:47:51.410874 run create_hlr_db(pid=8401): Terminated: ok {rc=0} 19:47:51.846743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Launched 19:47:52.150595 run osmo-hlr_10.42.42.2(pid=8404): Launched 19:47:52.265864 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:52.788587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Launched 19:47:53.091929 run osmo-stp_10.42.42.5(pid=8407): Launched 19:47:53.207500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:47:53.729937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8409): Launched 19:47:53.846481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:47:54.102656 run patchelf(pid=8410): Launched 19:47:54.270318 run osmo-stp_10.42.42.5(pid=8407): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] 19:47:54.398413 run osmo-stp_10.42.42.5(pid=8407): stdout: | (launched: 2022-12-09_19:47:53.035836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:54.528023 run osmo-stp_10.42.42.5(pid=8407): stderr: | [0;m[38;5;43m20221209194753206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194753206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194753207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194753207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:54.657498 run osmo-stp_10.42.42.5(pid=8407): stdout: | (launched: 2022-12-09_19:47:53.035836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:54.782178 run osmo-stp_10.42.42.5(pid=8407): stderr: | [0;m[38;5;43m20221209194753206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194753206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194753207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194753207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194753210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:54.929691 run patchelf(pid=8410): Terminating (SIGINT) 19:47:55.098732 run patchelf(pid=8410): Terminated: ok {rc=0} 19:47:55.220351 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8407): Process ended prematurely: osmo-stp_10.42.42.5(pid=8407) [trial-2363↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] [trial-2363↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 19:47:55.229412 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:47:55.255915 run osmo-hlr_10.42.42.2(pid=8404): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8404)] 19:47:55.302823 run osmo-hlr_10.42.42.2(pid=8404): stdout: | (launched: 2022-12-09_19:47:52.094490) 19:47:55.351697 run osmo-hlr_10.42.42.2(pid=8404): stderr: | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194752269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194752286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194752295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194752295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194752295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:55.400533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Terminating (SIGTERM) 19:47:55.439727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Terminating (SIGTERM) 19:47:55.478943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8409): Terminating (SIGTERM) 19:47:55.518859 --- ParallelTerminationStrategy: PID 8403 died... 19:47:55.537536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Terminated: ok {rc=0} 19:47:55.581419 --- ParallelTerminationStrategy: PID 8406 died... 19:47:55.599923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Terminated: ok {rc=0} 19:47:55.644077 --- ParallelTerminationStrategy: PID 8409 died... 19:47:55.662730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8409): Terminated: ok {rc=0} 19:47:55.748512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 19:47:57.048204 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:57.054635 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:47:57.086064 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:47:57.123536 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:47:57.209335 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:47:57.240910 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:47:57.278803 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:47:57.879502 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:47:57.928857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:57.939682 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:47:57.991222 tst cs_paging_gprs_active.py: using LAC 23311 19:47:58.111689 tst cs_paging_gprs_active.py: using RAC 106 19:47:58.240901 tst cs_paging_gprs_active.py: using CellId 23311 19:47:58.368670 tst cs_paging_gprs_active.py: using BVCI 23312 19:47:58.488581 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.500060 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.511150 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.522663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.534216 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.545559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.556921 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.568386 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:47:58.579845 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:47:58.696817 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:47:58.812821 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:47:59.020470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:47:59.330946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8415): Launched 19:47:59.601635 run iperf3-srv_10.42.42.10(pid=8416): Launched 19:47:59.717239 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:47:59.925385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:00.236197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8417): Launched 19:48:00.504486 run iperf3-srv_10.42.42.10(pid=8418): Launched 19:48:00.619916 tst cs_paging_gprs_active.py:38: start network... 19:48:00.828020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:01.385168 run create_hlr_db(pid=8419): Launched 19:48:01.553712 bus /gobi_6: Setting Powered False 19:48:02.615671 run create_hlr_db(pid=8419): Terminated: ok {rc=0} 19:48:03.067083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8421): Launched 19:48:03.398688 run osmo-hlr_10.42.42.2(pid=8422): Launched 19:48:03.525993 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:04.096287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8424): Launched 19:48:04.428036 run osmo-stp_10.42.42.5(pid=8425): Launched 19:48:04.555144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:05.128473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8427): Launched 19:48:05.256222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:05.536027 run patchelf(pid=8428): Launched 19:48:05.720487 run osmo-stp_10.42.42.5(pid=8425): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8425)] 19:48:05.860617 run osmo-stp_10.42.42.5(pid=8425): stdout: | (launched: 2022-12-09_19:48:04.367643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:06.001604 run osmo-stp_10.42.42.5(pid=8425): stderr: | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194804561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:06.142849 run osmo-stp_10.42.42.5(pid=8425): stdout: | (launched: 2022-12-09_19:48:04.367643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:06.278143 run osmo-stp_10.42.42.5(pid=8425): stderr: | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194804560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194804561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194804563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:06.438635 run patchelf(pid=8428): Terminating (SIGINT) 19:48:06.623520 run patchelf(pid=8428): Terminated: ok {rc=0} 19:48:06.757070 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8425): Process ended prematurely: osmo-stp_10.42.42.5(pid=8425) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8425)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:48:06.767398 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:48:06.796420 run osmo-hlr_10.42.42.2(pid=8422): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8422)] 19:48:06.846009 run osmo-hlr_10.42.42.2(pid=8422): stdout: | (launched: 2022-12-09_19:48:03.338472) 19:48:06.897245 run osmo-hlr_10.42.42.2(pid=8422): stderr: | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194803538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194803551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194803559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194803560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194803560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:06.948863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8415): Terminating (SIGTERM) 19:48:06.990502 run iperf3-srv_10.42.42.10(pid=8416): Terminating (SIGTERM) 19:48:07.031872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8417): Terminating (SIGTERM) 19:48:07.073327 run iperf3-srv_10.42.42.10(pid=8418): Terminating (SIGTERM) 19:48:07.114706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8421): Terminating (SIGTERM) 19:48:07.156071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8424): Terminating (SIGTERM) 19:48:07.197311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8427): Terminating (SIGTERM) 19:48:07.238999 --- ParallelTerminationStrategy: PID 8415 died... 19:48:07.258401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8415): Terminated: ok {rc=0} 19:48:07.304495 --- ParallelTerminationStrategy: PID 8416 died... 19:48:07.323673 run iperf3-srv_10.42.42.10(pid=8416): Terminated {rc=256} 19:48:07.369685 --- ParallelTerminationStrategy: PID 8417 died... 19:48:07.389152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8417): Terminated: ok {rc=0} 19:48:07.435071 --- ParallelTerminationStrategy: PID 8418 died... 19:48:07.454363 run iperf3-srv_10.42.42.10(pid=8418): Terminated {rc=256} 19:48:07.500318 --- ParallelTerminationStrategy: PID 8421 died... 19:48:07.519775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8421): Terminated: ok {rc=0} 19:48:07.566203 --- ParallelTerminationStrategy: PID 8424 died... 19:48:07.585604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8424): Terminated: ok {rc=0} 19:48:07.631706 --- ParallelTerminationStrategy: PID 8427 died... 19:48:07.651158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8427): Terminated: ok {rc=0} 19:48:07.738742 bus /gobi_0: Setting Powered False 19:48:08.838261 bus /gobi_0: Setting Powered False 19:48:09.954391 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:48:11.104112 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.116156 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:48:11.169408 tst iperf3.py: using LAC 23312 19:48:11.298443 tst iperf3.py: using RAC 107 19:48:11.426987 tst iperf3.py: using CellId 23312 19:48:11.558397 tst iperf3.py: using BVCI 23313 19:48:11.670557 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.681482 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.692178 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.702973 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.713571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.724108 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.734892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.745876 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:11.756567 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:11.875412 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:48:12.101881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:12.435767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8429): Launched 19:48:12.726476 run iperf3-srv_10.42.42.10(pid=8430): Launched 19:48:12.853328 tst iperf3.py:8: start network... 19:48:13.078148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:13.591787 run create_hlr_db(pid=8431): Launched 19:48:13.717356 bus /gobi_6: Setting Powered False 19:48:14.782969 run create_hlr_db(pid=8431): Terminated: ok {rc=0} 19:48:15.224121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8433): Launched 19:48:15.534123 run osmo-hlr_10.42.42.2(pid=8434): Launched 19:48:15.651221 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:16.252235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8436): Launched 19:48:16.602372 run osmo-stp_10.42.42.5(pid=8437): Launched 19:48:16.877095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:17.496443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8439): Launched 19:48:17.622828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:17.902787 run patchelf(pid=8440): Launched 19:48:18.086062 run osmo-stp_10.42.42.5(pid=8437): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8437)] 19:48:18.225594 run osmo-stp_10.42.42.5(pid=8437): stdout: | (launched: 2022-12-09_19:48:16.541774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:18.366782 run osmo-stp_10.42.42.5(pid=8437): stderr: | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194816791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:18.508093 run osmo-stp_10.42.42.5(pid=8437): stdout: | (launched: 2022-12-09_19:48:16.541774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:18.643271 run osmo-stp_10.42.42.5(pid=8437): stderr: | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194816790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194816791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194816791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:18.804034 run patchelf(pid=8440): Terminating (SIGINT) 19:48:18.988736 run patchelf(pid=8440): Terminated: ok {rc=0} 19:48:19.121906 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8437): Process ended prematurely: osmo-stp_10.42.42.5(pid=8437) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8437)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 19:48:19.132119 tst iperf3.py:8: Test FAILED (8.1 sec) 19:48:19.161189 run osmo-hlr_10.42.42.2(pid=8434): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8434)] 19:48:19.210761 run osmo-hlr_10.42.42.2(pid=8434): stdout: | (launched: 2022-12-09_19:48:15.477131) 19:48:19.261964 run osmo-hlr_10.42.42.2(pid=8434): stderr: | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194815656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194815668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194815677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194815677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194815677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:19.313572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8429): Terminating (SIGTERM) 19:48:19.355127 run iperf3-srv_10.42.42.10(pid=8430): Terminating (SIGTERM) 19:48:19.396829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8433): Terminating (SIGTERM) 19:48:19.439255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8436): Terminating (SIGTERM) 19:48:19.480942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8439): Terminating (SIGTERM) 19:48:19.523218 --- ParallelTerminationStrategy: PID 8429 died... 19:48:19.543250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8429): Terminated: ok {rc=0} 19:48:19.589852 --- ParallelTerminationStrategy: PID 8430 died... 19:48:19.609367 run iperf3-srv_10.42.42.10(pid=8430): Terminated {rc=256} 19:48:19.655840 --- ParallelTerminationStrategy: PID 8433 died... 19:48:19.675369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8433): Terminated: ok {rc=0} 19:48:19.721936 --- ParallelTerminationStrategy: PID 8436 died... 19:48:19.741696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8436): Terminated: ok {rc=0} 19:48:19.788218 --- ParallelTerminationStrategy: PID 8439 died... 19:48:19.807792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8439): Terminated: ok {rc=0} 19:48:19.896811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:48:21.047078 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.059158 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:48:21.110326 tst iperf3m4.py: using LAC 23313 19:48:21.240768 tst iperf3m4.py: using RAC 108 19:48:21.370796 tst iperf3m4.py: using CellId 23313 19:48:21.499486 tst iperf3m4.py: using BVCI 23314 19:48:21.619699 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.631145 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.642307 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.654249 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.666066 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.677913 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.690095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.701872 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:21.714459 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:21.836251 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:21.956635 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:22.072678 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:22.189861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:48:22.398362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:22.709452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8441): Launched 19:48:22.979436 run iperf3-srv_10.42.42.10(pid=8442): Launched 19:48:23.095162 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:48:23.302903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:23.614342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8443): Launched 19:48:23.885048 run iperf3-srv_10.42.42.10(pid=8444): Launched 19:48:24.000321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:48:24.207330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:24.518420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8445): Launched 19:48:24.789203 run iperf3-srv_10.42.42.10(pid=8446): Launched 19:48:24.904645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:48:25.112503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:25.423262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8447): Launched 19:48:25.691549 run iperf3-srv_10.42.42.10(pid=8448): Launched 19:48:25.806932 tst iperf3m4.py:8: start network... 19:48:26.014107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:26.491937 run create_hlr_db(pid=8449): Launched 19:48:26.618810 bus /gobi_6: Setting Powered False 19:48:27.679815 run create_hlr_db(pid=8449): Terminated: ok {rc=0} 19:48:28.131558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8451): Launched 19:48:28.464712 run osmo-hlr_10.42.42.2(pid=8452): Launched 19:48:28.591469 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:29.166208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8454): Launched 19:48:29.498665 run osmo-stp_10.42.42.5(pid=8455): Launched 19:48:29.625671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:30.196166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8457): Launched 19:48:30.322161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:30.601516 run patchelf(pid=8458): Launched 19:48:30.784491 run osmo-stp_10.42.42.5(pid=8455): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8455)] 19:48:30.940497 run osmo-stp_10.42.42.5(pid=8455): stdout: | (launched: 2022-12-09_19:48:29.438199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:31.083426 run osmo-stp_10.42.42.5(pid=8455): stderr: | [0;m[38;5;43m20221209194829629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194829629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194829630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194829630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:31.220916 run osmo-stp_10.42.42.5(pid=8455): stdout: | (launched: 2022-12-09_19:48:29.438199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:31.352663 run osmo-stp_10.42.42.5(pid=8455): stderr: | [0;m[38;5;43m20221209194829629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194829629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194829630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194829630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194829631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:31.510490 run patchelf(pid=8458): Terminating (SIGINT) 19:48:31.697709 run patchelf(pid=8458): Terminated: ok {rc=0} 19:48:31.834016 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8455): Process ended prematurely: osmo-stp_10.42.42.5(pid=8455) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8455)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 19:48:31.845429 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:48:31.877753 run osmo-hlr_10.42.42.2(pid=8452): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8452)] 19:48:31.929910 run osmo-hlr_10.42.42.2(pid=8452): stdout: | (launched: 2022-12-09_19:48:28.403725) 19:48:31.983186 run osmo-hlr_10.42.42.2(pid=8452): stderr: | [0;m[1;31m20221209194828604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194828604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194828604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194828604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194828605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194828605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194828617 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194828625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194828625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194828625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:32.037357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8441): Terminating (SIGTERM) 19:48:32.081577 run iperf3-srv_10.42.42.10(pid=8442): Terminating (SIGTERM) 19:48:32.127439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8443): Terminating (SIGTERM) 19:48:32.171672 run iperf3-srv_10.42.42.10(pid=8444): Terminating (SIGTERM) 19:48:32.214952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8445): Terminating (SIGTERM) 19:48:32.256311 run iperf3-srv_10.42.42.10(pid=8446): Terminating (SIGTERM) 19:48:32.297587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8447): Terminating (SIGTERM) 19:48:32.339090 run iperf3-srv_10.42.42.10(pid=8448): Terminating (SIGTERM) 19:48:32.380640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8451): Terminating (SIGTERM) 19:48:32.422472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8454): Terminating (SIGTERM) 19:48:32.463834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8457): Terminating (SIGTERM) 19:48:32.505380 --- ParallelTerminationStrategy: PID 8441 died... 19:48:32.524885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8441): Terminated: ok {rc=0} 19:48:32.570985 --- ParallelTerminationStrategy: PID 8442 died... 19:48:32.590291 run iperf3-srv_10.42.42.10(pid=8442): Terminated {rc=256} 19:48:32.636208 --- ParallelTerminationStrategy: PID 8443 died... 19:48:32.655528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8443): Terminated: ok {rc=0} 19:48:32.701380 --- ParallelTerminationStrategy: PID 8444 died... 19:48:32.720603 run iperf3-srv_10.42.42.10(pid=8444): Terminated {rc=256} 19:48:32.766932 --- ParallelTerminationStrategy: PID 8445 died... 19:48:32.786220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8445): Terminated: ok {rc=0} 19:48:32.832288 --- ParallelTerminationStrategy: PID 8446 died... 19:48:32.851615 run iperf3-srv_10.42.42.10(pid=8446): Terminated {rc=256} 19:48:32.897379 --- ParallelTerminationStrategy: PID 8447 died... 19:48:32.916874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8447): Terminated: ok {rc=0} 19:48:32.962818 --- ParallelTerminationStrategy: PID 8448 died... 19:48:32.982468 run iperf3-srv_10.42.42.10(pid=8448): Terminated {rc=256} 19:48:33.028551 --- ParallelTerminationStrategy: PID 8451 died... 19:48:33.048130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8451): Terminated: ok {rc=0} 19:48:33.094422 --- ParallelTerminationStrategy: PID 8454 died... 19:48:33.114063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8454): Terminated: ok {rc=0} 19:48:33.160278 --- ParallelTerminationStrategy: PID 8457 died... 19:48:33.179943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8457): Terminated: ok {rc=0} 19:48:33.267067 bus /gobi_4: Setting Powered False 19:48:34.364486 bus /gobi_4: Setting Powered False 19:48:35.478136 bus /gobi_1: Setting Powered False 19:48:36.576191 bus /gobi_1: Setting Powered False 19:48:37.690024 bus /gobi_0: Setting Powered False 19:48:38.786403 bus /gobi_0: Setting Powered False 19:48:39.901833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 19:48:41.003853 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.015887 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:48:41.065420 tst ping.py: using LAC 23314 19:48:41.187146 tst ping.py: using RAC 109 19:48:41.307237 tst ping.py: using CellId 23314 19:48:41.427758 tst ping.py: using BVCI 23315 19:48:41.537191 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.548059 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.558881 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.569597 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.580325 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.590923 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.601765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:41.612414 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:41.730286 tst ping.py:19: start network... 19:48:41.949704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:42.450860 run create_hlr_db(pid=8459): Launched 19:48:42.574576 bus /gobi_6: Setting Powered False 19:48:43.638809 run create_hlr_db(pid=8459): Terminated: ok {rc=0} 19:48:44.072820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8461): Launched 19:48:44.376883 run osmo-hlr_10.42.42.2(pid=8462): Launched 19:48:44.492826 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:45.021395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8464): Launched 19:48:45.326893 run osmo-stp_10.42.42.5(pid=8465): Launched 19:48:45.442335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:45.995382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8467): Launched 19:48:46.136570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:46.419552 run patchelf(pid=8468): Launched 19:48:46.615328 run osmo-stp_10.42.42.5(pid=8465): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8465)] 19:48:46.758015 run osmo-stp_10.42.42.5(pid=8465): stdout: | (launched: 2022-12-09_19:48:45.270176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:46.902032 run osmo-stp_10.42.42.5(pid=8465): stderr: | [0;m[38;5;43m20221209194845442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194845443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194845443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194845443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:47.047712 run osmo-stp_10.42.42.5(pid=8465): stdout: | (launched: 2022-12-09_19:48:45.270176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:47.186289 run osmo-stp_10.42.42.5(pid=8465): stderr: | [0;m[38;5;43m20221209194845442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194845443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194845443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194845443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194845444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:47.344231 run patchelf(pid=8468): Terminating (SIGINT) 19:48:47.526113 run patchelf(pid=8468): Terminated: ok {rc=0} 19:48:47.657091 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8465): Process ended prematurely: osmo-stp_10.42.42.5(pid=8465) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8465)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 19:48:47.667029 tst ping.py:22: Test FAILED (6.7 sec) 19:48:47.695893 run osmo-hlr_10.42.42.2(pid=8462): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8462)] 19:48:47.745557 run osmo-hlr_10.42.42.2(pid=8462): stdout: | (launched: 2022-12-09_19:48:44.320239) 19:48:47.797369 run osmo-hlr_10.42.42.2(pid=8462): stderr: | [0;m[1;31m20221209194844496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194844496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194844496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194844496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194844496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194844497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194844510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194844519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194844519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194844519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:47.849631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8461): Terminating (SIGTERM) 19:48:47.891396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8464): Terminating (SIGTERM) 19:48:47.933185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8467): Terminating (SIGTERM) 19:48:47.975210 --- ParallelTerminationStrategy: PID 8461 died... 19:48:47.995220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8461): Terminated: ok {rc=0} 19:48:48.041799 --- ParallelTerminationStrategy: PID 8464 died... 19:48:48.061370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8464): Terminated: ok {rc=0} 19:48:48.107681 --- ParallelTerminationStrategy: PID 8467 died... 19:48:48.127210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8467): Terminated: ok {rc=0} 19:48:48.214976 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:48:49.301529 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.313764 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:48:49.366733 tst ping_idle_ping.py: using LAC 23315 19:48:49.494236 tst ping_idle_ping.py: using RAC 110 19:48:49.621850 tst ping_idle_ping.py: using CellId 23315 19:48:49.748689 tst ping_idle_ping.py: using BVCI 23316 19:48:49.859280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.870440 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.881358 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.892145 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.903073 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.914036 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.925004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:48:49.936004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:48:50.055391 tst ping_idle_ping.py:24: start network... 19:48:50.275255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:50.783329 run create_hlr_db(pid=8469): Launched 19:48:50.907852 bus /gobi_6: Setting Powered False 19:48:51.972562 run create_hlr_db(pid=8469): Terminated: ok {rc=0} 19:48:52.426924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Launched 19:48:52.754116 run osmo-hlr_10.42.42.2(pid=8472): Launched 19:48:52.879234 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:53.445588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Launched 19:48:53.772135 run osmo-stp_10.42.42.5(pid=8475): Launched 19:48:53.896272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:54.460104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Launched 19:48:54.584331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:54.861238 run patchelf(pid=8478): Launched 19:48:55.041876 run osmo-stp_10.42.42.5(pid=8475): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] 19:48:55.178853 run osmo-stp_10.42.42.5(pid=8475): stdout: | (launched: 2022-12-09_19:48:53.711568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:55.318601 run osmo-stp_10.42.42.5(pid=8475): stderr: | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194853907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:55.457163 run osmo-stp_10.42.42.5(pid=8475): stdout: | (launched: 2022-12-09_19:48:53.711568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:55.590135 run osmo-stp_10.42.42.5(pid=8475): stderr: | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194853906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194853907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194853907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:55.747714 run patchelf(pid=8478): Terminating (SIGINT) 19:48:55.929823 run patchelf(pid=8478): Terminated: ok {rc=0} 19:48:56.060626 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8475): Process ended prematurely: osmo-stp_10.42.42.5(pid=8475) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 19:48:56.070283 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:48:56.098914 run osmo-hlr_10.42.42.2(pid=8472): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8472)] 19:48:56.148919 run osmo-hlr_10.42.42.2(pid=8472): stdout: | (launched: 2022-12-09_19:48:52.693537) 19:48:56.200385 run osmo-hlr_10.42.42.2(pid=8472): stderr: | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194852893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194852906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194852915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194852915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194852915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:56.252236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Terminating (SIGTERM) 19:48:56.294154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Terminating (SIGTERM) 19:48:56.335790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Terminating (SIGTERM) 19:48:56.377654 --- ParallelTerminationStrategy: PID 8471 died... 19:48:56.397670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Terminated: ok {rc=0} 19:48:56.444118 --- ParallelTerminationStrategy: PID 8474 died... 19:48:56.463526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Terminated: ok {rc=0} 19:48:56.509647 --- ParallelTerminationStrategy: PID 8477 died... 19:48:56.529396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Terminated: ok {rc=0} 19:48:56.616135 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:48:57.917658 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:48:57.924533 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:48:57.956339 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:48:57.993999 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:48:58.081672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:48:58.114092 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:48:58.151661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:48:58.744432 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:48:58.793960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:58.804714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:48:58.870489 tst cs_paging_gprs_active.py: using LAC 23316 19:48:58.992324 tst cs_paging_gprs_active.py: using RAC 111 19:48:59.114697 tst cs_paging_gprs_active.py: using CellId 23316 19:48:59.243196 tst cs_paging_gprs_active.py: using BVCI 23317 19:48:59.356818 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.367751 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.378539 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.389272 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.399914 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.410625 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.421362 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.431905 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:48:59.442769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:48:59.562960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:48:59.684093 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:48:59.909641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:00.242802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Launched 19:49:00.530329 run iperf3-srv_10.42.42.10(pid=8487): Launched 19:49:00.653911 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:49:00.879081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:01.218728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8488): Launched 19:49:01.523702 run iperf3-srv_10.42.42.10(pid=8489): Launched 19:49:01.659323 tst cs_paging_gprs_active.py:38: start network... 19:49:01.880073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:02.403133 run create_hlr_db(pid=8490): Launched 19:49:02.535745 bus /gobi_6: Setting Powered False 19:49:03.600838 run create_hlr_db(pid=8490): Terminated: ok {rc=0} 19:49:04.041853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Launched 19:49:04.351346 run osmo-hlr_10.42.42.2(pid=8493): Launched 19:49:04.468563 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:05.002651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Launched 19:49:05.311621 run osmo-stp_10.42.42.5(pid=8496): Launched 19:49:05.428633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:05.962841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8498): Launched 19:49:06.080185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:06.341676 run patchelf(pid=8499): Launched 19:49:06.512527 run osmo-stp_10.42.42.5(pid=8496): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] 19:49:06.642876 run osmo-stp_10.42.42.5(pid=8496): stdout: | (launched: 2022-12-09_19:49:05.254052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:06.774655 run osmo-stp_10.42.42.5(pid=8496): stderr: | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194905428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:06.906425 run osmo-stp_10.42.42.5(pid=8496): stdout: | (launched: 2022-12-09_19:49:05.254052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:07.032225 run osmo-stp_10.42.42.5(pid=8496): stderr: | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194905427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194905428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194905428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:07.181518 run patchelf(pid=8499): Terminating (SIGINT) 19:49:07.355104 run patchelf(pid=8499): Terminated: ok {rc=0} 19:49:07.479500 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8496): Process ended prematurely: osmo-stp_10.42.42.5(pid=8496) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:49:07.490226 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:49:07.517372 run osmo-hlr_10.42.42.2(pid=8493): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8493)] 19:49:07.564250 run osmo-hlr_10.42.42.2(pid=8493): stdout: | (launched: 2022-12-09_19:49:04.293761) 19:49:07.612661 run osmo-hlr_10.42.42.2(pid=8493): stderr: | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194904471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194904484 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194904493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194904493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194904493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:07.661715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Terminating (SIGTERM) 19:49:07.700691 run iperf3-srv_10.42.42.10(pid=8487): Terminating (SIGTERM) 19:49:07.739628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8488): Terminating (SIGTERM) 19:49:07.778646 run iperf3-srv_10.42.42.10(pid=8489): Terminating (SIGTERM) 19:49:07.817619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Terminating (SIGTERM) 19:49:07.856738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Terminating (SIGTERM) 19:49:07.895734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8498): Terminating (SIGTERM) 19:49:07.934883 --- ParallelTerminationStrategy: PID 8486 died... 19:49:07.953760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Terminated: ok {rc=0} 19:49:07.997100 --- ParallelTerminationStrategy: PID 8487 died... 19:49:08.015462 run iperf3-srv_10.42.42.10(pid=8487): Terminated {rc=256} 19:49:08.058486 --- ParallelTerminationStrategy: PID 8488 died... 19:49:08.076715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8488): Terminated: ok {rc=0} 19:49:08.119840 --- ParallelTerminationStrategy: PID 8489 died... 19:49:08.138188 run iperf3-srv_10.42.42.10(pid=8489): Terminated {rc=256} 19:49:08.181697 --- ParallelTerminationStrategy: PID 8492 died... 19:49:08.200120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Terminated: ok {rc=0} 19:49:08.243151 --- ParallelTerminationStrategy: PID 8495 died... 19:49:08.261601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Terminated: ok {rc=0} 19:49:08.305211 --- ParallelTerminationStrategy: PID 8498 died... 19:49:08.323551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8498): Terminated: ok {rc=0} 19:49:08.408128 bus /gobi_0: Setting Powered False 19:49:09.508021 bus /gobi_0: Setting Powered False 19:49:10.622682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:49:11.769394 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:11.780788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:49:11.849095 tst iperf3.py: using LAC 23317 19:49:11.969831 tst iperf3.py: using RAC 112 19:49:12.091008 tst iperf3.py: using CellId 23317 19:49:12.213285 tst iperf3.py: using BVCI 23318 19:49:12.324815 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.335749 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.346500 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.357207 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.367875 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.378620 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.389445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.400024 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:12.410839 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:12.529263 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:12.754309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:13.088896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8500): Launched 19:49:13.378518 run iperf3-srv_10.42.42.10(pid=8501): Launched 19:49:13.502688 tst iperf3.py:8: start network... 19:49:13.727299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:14.242728 run create_hlr_db(pid=8502): Launched 19:49:14.369445 bus /gobi_6: Setting Powered False 19:49:15.431237 run create_hlr_db(pid=8502): Terminated: ok {rc=0} 19:49:15.889852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Launched 19:49:16.243282 run osmo-hlr_10.42.42.2(pid=8505): Launched 19:49:16.462616 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:17.061755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Launched 19:49:17.448156 run osmo-stp_10.42.42.5(pid=8508): Launched 19:49:17.576092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:18.147795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8510): Launched 19:49:18.273590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:18.553159 run patchelf(pid=8511): Launched 19:49:18.736209 run osmo-stp_10.42.42.5(pid=8508): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] 19:49:18.875930 run osmo-stp_10.42.42.5(pid=8508): stdout: | (launched: 2022-12-09_19:49:17.387206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:19.016682 run osmo-stp_10.42.42.5(pid=8508): stderr: | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194917581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:19.157642 run osmo-stp_10.42.42.5(pid=8508): stdout: | (launched: 2022-12-09_19:49:17.387206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:19.292804 run osmo-stp_10.42.42.5(pid=8508): stderr: | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194917581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194917581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194917582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:19.453209 run patchelf(pid=8511): Terminating (SIGINT) 19:49:19.638021 run patchelf(pid=8511): Terminated: ok {rc=0} 19:49:19.771647 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8508): Process ended prematurely: osmo-stp_10.42.42.5(pid=8508) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 19:49:19.782042 tst iperf3.py:8: Test FAILED (8.0 sec) 19:49:19.811160 run osmo-hlr_10.42.42.2(pid=8505): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8505)] 19:49:19.861522 run osmo-hlr_10.42.42.2(pid=8505): stdout: | (launched: 2022-12-09_19:49:16.182797) 19:49:19.913225 run osmo-hlr_10.42.42.2(pid=8505): stderr: | [0;m[1;31m20221209194916439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194916439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194916440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194916440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194916440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194916440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194916452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194916468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194916468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194916468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:19.965309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8500): Terminating (SIGTERM) 19:49:20.007302 run iperf3-srv_10.42.42.10(pid=8501): Terminating (SIGTERM) 19:49:20.049180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Terminating (SIGTERM) 19:49:20.091140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Terminating (SIGTERM) 19:49:20.132891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8510): Terminating (SIGTERM) 19:49:20.175457 --- ParallelTerminationStrategy: PID 8500 died... 19:49:20.195565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8500): Terminated: ok {rc=0} 19:49:20.243173 --- ParallelTerminationStrategy: PID 8501 died... 19:49:20.262922 run iperf3-srv_10.42.42.10(pid=8501): Terminated {rc=256} 19:49:20.309616 --- ParallelTerminationStrategy: PID 8504 died... 19:49:20.329313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8504): Terminated: ok {rc=0} 19:49:20.375980 --- ParallelTerminationStrategy: PID 8507 died... 19:49:20.395523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8507): Terminated: ok {rc=0} 19:49:20.441967 --- ParallelTerminationStrategy: PID 8510 died... 19:49:20.461534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8510): Terminated: ok {rc=0} 19:49:20.549325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:49:21.697801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:21.709978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:49:21.776641 tst iperf3m4.py: using LAC 23318 19:49:21.908587 tst iperf3m4.py: using RAC 113 19:49:22.038284 tst iperf3m4.py: using CellId 23318 19:49:22.168829 tst iperf3m4.py: using BVCI 23319 19:49:22.282637 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.293991 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.305040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.316481 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.327604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.338687 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.349635 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.360162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:22.371040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:22.486997 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:22.612249 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:22.734721 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:22.855281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:23.080318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:23.414212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8512): Launched 19:49:23.704033 run iperf3-srv_10.42.42.10(pid=8513): Launched 19:49:23.828814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:49:24.053286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:24.386984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8514): Launched 19:49:24.675582 run iperf3-srv_10.42.42.10(pid=8515): Launched 19:49:24.799886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:49:25.024127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:25.358165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8516): Launched 19:49:25.648304 run iperf3-srv_10.42.42.10(pid=8517): Launched 19:49:25.772396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:49:25.996621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:26.331056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8518): Launched 19:49:26.619359 run iperf3-srv_10.42.42.10(pid=8519): Launched 19:49:26.743056 tst iperf3m4.py:8: start network... 19:49:26.967738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:27.480860 run create_hlr_db(pid=8520): Launched 19:49:27.607865 bus /gobi_6: Setting Powered False 19:49:28.673554 run create_hlr_db(pid=8520): Terminated: ok {rc=0} 19:49:29.114246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8522): Launched 19:49:29.423951 run osmo-hlr_10.42.42.2(pid=8523): Launched 19:49:29.542122 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:30.076790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8525): Launched 19:49:30.386141 run osmo-stp_10.42.42.5(pid=8526): Launched 19:49:30.503362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:31.073181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8528): Launched 19:49:31.198160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:31.471837 run patchelf(pid=8529): Launched 19:49:31.673959 run osmo-stp_10.42.42.5(pid=8526): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8526)] 19:49:31.818272 run osmo-stp_10.42.42.5(pid=8526): stdout: | (launched: 2022-12-09_19:49:30.328443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:31.966166 run osmo-stp_10.42.42.5(pid=8526): stderr: | [0;m[38;5;43m20221209194930498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194930499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194930499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194930499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:32.111479 run osmo-stp_10.42.42.5(pid=8526): stdout: | (launched: 2022-12-09_19:49:30.328443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:32.251259 run osmo-stp_10.42.42.5(pid=8526): stderr: | [0;m[38;5;43m20221209194930498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194930499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194930499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194930499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194930500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:32.412041 run patchelf(pid=8529): Terminating (SIGINT) 19:49:32.597031 run patchelf(pid=8529): Terminated: ok {rc=0} 19:49:32.729970 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8526): Process ended prematurely: osmo-stp_10.42.42.5(pid=8526) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8526)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:49:32.740439 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:49:32.770063 run osmo-hlr_10.42.42.2(pid=8523): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8523)] 19:49:32.820481 run osmo-hlr_10.42.42.2(pid=8523): stdout: | (launched: 2022-12-09_19:49:29.366311) 19:49:32.872262 run osmo-hlr_10.42.42.2(pid=8523): stderr: | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194929542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194929555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194929564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194929565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194929565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:32.924526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8512): Terminating (SIGTERM) 19:49:32.966384 run iperf3-srv_10.42.42.10(pid=8513): Terminating (SIGTERM) 19:49:33.008138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8514): Terminating (SIGTERM) 19:49:33.050053 run iperf3-srv_10.42.42.10(pid=8515): Terminating (SIGTERM) 19:49:33.091781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8516): Terminating (SIGTERM) 19:49:33.133695 run iperf3-srv_10.42.42.10(pid=8517): Terminating (SIGTERM) 19:49:33.175437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8518): Terminating (SIGTERM) 19:49:33.217342 run iperf3-srv_10.42.42.10(pid=8519): Terminating (SIGTERM) 19:49:33.259134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8522): Terminating (SIGTERM) 19:49:33.300991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8525): Terminating (SIGTERM) 19:49:33.343020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8528): Terminating (SIGTERM) 19:49:33.385234 --- ParallelTerminationStrategy: PID 8512 died... 19:49:33.405043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8512): Terminated: ok {rc=0} 19:49:33.451821 --- ParallelTerminationStrategy: PID 8513 died... 19:49:33.471389 run iperf3-srv_10.42.42.10(pid=8513): Terminated {rc=256} 19:49:33.518043 --- ParallelTerminationStrategy: PID 8514 died... 19:49:33.537914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8514): Terminated: ok {rc=0} 19:49:33.584629 --- ParallelTerminationStrategy: PID 8515 died... 19:49:33.604403 run iperf3-srv_10.42.42.10(pid=8515): Terminated {rc=256} 19:49:33.651145 --- ParallelTerminationStrategy: PID 8516 died... 19:49:33.670811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8516): Terminated: ok {rc=0} 19:49:33.717550 --- ParallelTerminationStrategy: PID 8517 died... 19:49:33.737322 run iperf3-srv_10.42.42.10(pid=8517): Terminated {rc=256} 19:49:33.784156 --- ParallelTerminationStrategy: PID 8518 died... 19:49:33.803884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8518): Terminated: ok {rc=0} 19:49:33.850569 --- ParallelTerminationStrategy: PID 8519 died... 19:49:33.870195 run iperf3-srv_10.42.42.10(pid=8519): Terminated {rc=256} 19:49:33.916801 --- ParallelTerminationStrategy: PID 8522 died... 19:49:33.936865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8522): Terminated: ok {rc=0} 19:49:33.983530 --- ParallelTerminationStrategy: PID 8525 died... 19:49:34.003269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8525): Terminated: ok {rc=0} 19:49:34.049944 --- ParallelTerminationStrategy: PID 8528 died... 19:49:34.069697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8528): Terminated: ok {rc=0} 19:49:34.158129 bus /gobi_4: Setting Powered False 19:49:35.256520 bus /gobi_4: Setting Powered False 19:49:36.373483 bus /gobi_1: Setting Powered False 19:49:37.471258 bus /gobi_1: Setting Powered False 19:49:38.589981 bus /gobi_0: Setting Powered False 19:49:39.687904 bus /gobi_0: Setting Powered False 19:49:40.802309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:49:41.904879 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:41.916505 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:49:41.983947 tst ping.py: using LAC 23319 19:49:42.105084 tst ping.py: using RAC 114 19:49:42.225081 tst ping.py: using CellId 23319 19:49:42.343905 tst ping.py: using BVCI 23320 19:49:42.455328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.466426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.477210 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.487916 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.498683 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.509476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.520236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:42.530990 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:42.645801 tst ping.py:19: start network... 19:49:42.848873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:43.319668 run create_hlr_db(pid=8530): Launched 19:49:43.443991 bus /gobi_6: Setting Powered False 19:49:44.505234 run create_hlr_db(pid=8530): Terminated: ok {rc=0} 19:49:44.951263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8532): Launched 19:49:45.278731 run osmo-hlr_10.42.42.2(pid=8533): Launched 19:49:45.403802 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:45.985718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8535): Launched 19:49:46.319713 run osmo-stp_10.42.42.5(pid=8536): Launched 19:49:46.528106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:47.177509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8538): Launched 19:49:47.298167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:47.555739 run patchelf(pid=8539): Launched 19:49:47.725391 run osmo-stp_10.42.42.5(pid=8536): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8536)] 19:49:47.852925 run osmo-stp_10.42.42.5(pid=8536): stdout: | (launched: 2022-12-09_19:49:46.258486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:47.982028 run osmo-stp_10.42.42.5(pid=8536): stderr: | [0;m[38;5;43m20221209194946527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194946528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194946528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194946528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:48.110818 run osmo-stp_10.42.42.5(pid=8536): stdout: | (launched: 2022-12-09_19:49:46.258486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:48.234500 run osmo-stp_10.42.42.5(pid=8536): stderr: | [0;m[38;5;43m20221209194946527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194946528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194946528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194946528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194946529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:48.381064 run patchelf(pid=8539): Terminating (SIGINT) 19:49:48.550339 run patchelf(pid=8539): Terminated: ok {rc=0} 19:49:48.672611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8536): Process ended prematurely: osmo-stp_10.42.42.5(pid=8536) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8536)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 19:49:48.681692 tst ping.py:22: Test FAILED (6.8 sec) 19:49:48.708503 run osmo-hlr_10.42.42.2(pid=8533): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8533)] 19:49:48.755308 run osmo-hlr_10.42.42.2(pid=8533): stdout: | (launched: 2022-12-09_19:49:45.218533) 19:49:48.803740 run osmo-hlr_10.42.42.2(pid=8533): stderr: | [0;m[1;31m20221209194945417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194945417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194945417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194945417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194945417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194945418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194945431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194945441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194945441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194945441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:48.852301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8532): Terminating (SIGTERM) 19:49:48.891460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8535): Terminating (SIGTERM) 19:49:48.930757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8538): Terminating (SIGTERM) 19:49:48.970140 --- ParallelTerminationStrategy: PID 8532 died... 19:49:48.989111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8532): Terminated: ok {rc=0} 19:49:49.032720 --- ParallelTerminationStrategy: PID 8535 died... 19:49:49.051483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8535): Terminated: ok {rc=0} 19:49:49.095378 --- ParallelTerminationStrategy: PID 8538 died... 19:49:49.114685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8538): Terminated: ok {rc=0} 19:49:49.200103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:49:50.289561 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.301845 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:49:50.373309 tst ping_idle_ping.py: using LAC 23320 19:49:50.492305 tst ping_idle_ping.py: using RAC 115 19:49:50.609606 tst ping_idle_ping.py: using CellId 23320 19:49:50.726840 tst ping_idle_ping.py: using BVCI 23321 19:49:50.836423 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.847409 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.858291 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.869066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.879706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.890534 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.901413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:49:50.912150 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:49:51.030349 tst ping_idle_ping.py:24: start network... 19:49:51.252109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:51.763632 run create_hlr_db(pid=8540): Launched 19:49:51.890041 bus /gobi_6: Setting Powered False 19:49:52.955088 run create_hlr_db(pid=8540): Terminated: ok {rc=0} 19:49:53.410958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Launched 19:49:53.739642 run osmo-hlr_10.42.42.2(pid=8543): Launched 19:49:53.865762 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:54.427468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Launched 19:49:54.754837 run osmo-stp_10.42.42.5(pid=8546): Launched 19:49:54.880068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:55.443966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8548): Launched 19:49:55.568136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:55.844552 run patchelf(pid=8549): Launched 19:49:56.025566 run osmo-stp_10.42.42.5(pid=8546): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] 19:49:56.162997 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-09_19:49:54.694328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:56.301866 run osmo-stp_10.42.42.5(pid=8546): stderr: | [0;m[38;5;43m20221209194954885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194954886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194954886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194954886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:56.440759 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-09_19:49:54.694328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:56.573946 run osmo-stp_10.42.42.5(pid=8546): stderr: | [0;m[38;5;43m20221209194954885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209194954886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209194954886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209194954886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209194954889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:56.731855 run patchelf(pid=8549): Terminating (SIGINT) 19:49:56.913891 run patchelf(pid=8549): Terminated: ok {rc=0} 19:49:57.044821 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:49:57.054540 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:49:57.083056 run osmo-hlr_10.42.42.2(pid=8543): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8543)] 19:49:57.132629 run osmo-hlr_10.42.42.2(pid=8543): stdout: | (launched: 2022-12-09_19:49:53.678666) 19:49:57.184235 run osmo-hlr_10.42.42.2(pid=8543): stderr: | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209194953878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209194953890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209194953899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209194953900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209194953900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:57.236002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Terminating (SIGTERM) 19:49:57.277423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Terminating (SIGTERM) 19:49:57.318947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8548): Terminating (SIGTERM) 19:49:57.360632 --- ParallelTerminationStrategy: PID 8542 died... 19:49:57.380419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Terminated: ok {rc=0} 19:49:57.426351 --- ParallelTerminationStrategy: PID 8545 died... 19:49:57.445799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Terminated: ok {rc=0} 19:49:57.492831 --- ParallelTerminationStrategy: PID 8548 died... 19:49:57.512730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8548): Terminated: ok {rc=0} 19:49:57.600822 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:49:58.912181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:49:58.922110 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:49:58.956560 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:49:58.995810 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:49:59.087404 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:49:59.121228 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:49:59.159242 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:49:59.754087 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:49:59.803914 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:49:59.815242 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:49:59.864031 tst cs_paging_gprs_active.py: using LAC 23321 19:49:59.982401 tst cs_paging_gprs_active.py: using RAC 116 19:50:00.101839 tst cs_paging_gprs_active.py: using CellId 23321 19:50:00.221404 tst cs_paging_gprs_active.py: using BVCI 23322 19:50:00.333354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.344502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.355667 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.366724 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.377788 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.388663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.399794 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.410670 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:00.421844 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:00.540670 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:00.658358 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:50:00.906930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:01.277188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Launched 19:50:01.564933 run iperf3-srv_10.42.42.10(pid=8558): Launched 19:50:01.696496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:50:01.922236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:02.239211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8562): Launched 19:50:02.517550 run iperf3-srv_10.42.42.10(pid=8563): Launched 19:50:02.631492 tst cs_paging_gprs_active.py:38: start network... 19:50:02.835921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:03.309255 run create_hlr_db(pid=8564): Launched 19:50:03.434079 bus /gobi_6: Setting Powered False 19:50:04.494524 run create_hlr_db(pid=8564): Terminated: ok {rc=0} 19:50:04.919752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8566): Launched 19:50:05.225119 run osmo-hlr_10.42.42.2(pid=8567): Launched 19:50:05.340451 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:05.877949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8569): Launched 19:50:06.182816 run osmo-stp_10.42.42.5(pid=8570): Launched 19:50:06.298113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:06.824277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8572): Launched 19:50:06.940088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:07.198160 run patchelf(pid=8573): Launched 19:50:07.366438 run osmo-stp_10.42.42.5(pid=8570): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8570)] 19:50:07.495181 run osmo-stp_10.42.42.5(pid=8570): stdout: | (launched: 2022-12-09_19:50:06.126090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:07.625282 run osmo-stp_10.42.42.5(pid=8570): stderr: | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195006297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:07.755526 run osmo-stp_10.42.42.5(pid=8570): stdout: | (launched: 2022-12-09_19:50:06.126090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:07.880620 run osmo-stp_10.42.42.5(pid=8570): stderr: | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195006296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195006297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195006297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:08.028068 run patchelf(pid=8573): Terminating (SIGINT) 19:50:08.199014 run patchelf(pid=8573): Terminated: ok {rc=0} 19:50:08.322126 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8570): Process ended prematurely: osmo-stp_10.42.42.5(pid=8570) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8570)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:50:08.331679 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:50:08.358353 run osmo-hlr_10.42.42.2(pid=8567): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8567)] 19:50:08.405446 run osmo-hlr_10.42.42.2(pid=8567): stdout: | (launched: 2022-12-09_19:50:05.168497) 19:50:08.453898 run osmo-hlr_10.42.42.2(pid=8567): stderr: | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195005348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195005360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195005369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195005369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195005369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:08.502945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Terminating (SIGTERM) 19:50:08.542333 run iperf3-srv_10.42.42.10(pid=8558): Terminating (SIGTERM) 19:50:08.581481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8562): Terminating (SIGTERM) 19:50:08.620613 run iperf3-srv_10.42.42.10(pid=8563): Terminating (SIGTERM) 19:50:08.659733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8566): Terminating (SIGTERM) 19:50:08.699118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8569): Terminating (SIGTERM) 19:50:08.738226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8572): Terminating (SIGTERM) 19:50:08.777533 --- ParallelTerminationStrategy: PID 8557 died... 19:50:08.796337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Terminated: ok {rc=0} 19:50:08.840024 --- ParallelTerminationStrategy: PID 8558 died... 19:50:08.858275 run iperf3-srv_10.42.42.10(pid=8558): Terminated {rc=256} 19:50:08.901453 --- ParallelTerminationStrategy: PID 8562 died... 19:50:08.919665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8562): Terminated: ok {rc=0} 19:50:08.962808 --- ParallelTerminationStrategy: PID 8563 died... 19:50:08.981080 run iperf3-srv_10.42.42.10(pid=8563): Terminated {rc=256} 19:50:09.024144 --- ParallelTerminationStrategy: PID 8566 died... 19:50:09.042445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8566): Terminated: ok {rc=0} 19:50:09.085475 --- ParallelTerminationStrategy: PID 8569 died... 19:50:09.103784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8569): Terminated: ok {rc=0} 19:50:09.146939 --- ParallelTerminationStrategy: PID 8572 died... 19:50:09.165237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8572): Terminated: ok {rc=0} 19:50:09.248256 bus /gobi_0: Setting Powered False 19:50:10.346043 bus /gobi_0: Setting Powered False 19:50:11.463231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:50:12.608745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:12.620671 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:50:12.670565 tst iperf3.py: using LAC 23322 19:50:12.795620 tst iperf3.py: using RAC 117 19:50:12.914988 tst iperf3.py: using CellId 23322 19:50:13.034418 tst iperf3.py: using BVCI 23323 19:50:13.144279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.155695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.166885 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.178028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.189144 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.200167 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.211381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.222510 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:13.233743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:13.350603 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:13.555078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:13.861802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8574): Launched 19:50:14.126487 run iperf3-srv_10.42.42.10(pid=8575): Launched 19:50:14.239869 tst iperf3.py:8: start network... 19:50:14.443900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:14.915129 run create_hlr_db(pid=8576): Launched 19:50:15.039187 bus /gobi_6: Setting Powered False 19:50:16.098098 run create_hlr_db(pid=8576): Terminated: ok {rc=0} 19:50:16.553561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Launched 19:50:16.897167 run osmo-hlr_10.42.42.2(pid=8579): Launched 19:50:17.147587 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:17.711585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Launched 19:50:18.038805 run osmo-stp_10.42.42.5(pid=8582): Launched 19:50:18.162691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:18.724123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8584): Launched 19:50:18.848646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:19.124746 run patchelf(pid=8585): Launched 19:50:19.305573 run osmo-stp_10.42.42.5(pid=8582): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] 19:50:19.443502 run osmo-stp_10.42.42.5(pid=8582): stdout: | (launched: 2022-12-09_19:50:17.978616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:19.583233 run osmo-stp_10.42.42.5(pid=8582): stderr: | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195018173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:19.723064 run osmo-stp_10.42.42.5(pid=8582): stdout: | (launched: 2022-12-09_19:50:17.978616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:19.857134 run osmo-stp_10.42.42.5(pid=8582): stderr: | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195018172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195018173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195018173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:20.015851 run patchelf(pid=8585): Terminating (SIGINT) 19:50:20.197879 run patchelf(pid=8585): Terminated: ok {rc=0} 19:50:20.329191 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8582): Process ended prematurely: osmo-stp_10.42.42.5(pid=8582) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:50:20.339502 tst iperf3.py:8: Test FAILED (7.8 sec) 19:50:20.368112 run osmo-hlr_10.42.42.2(pid=8579): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8579)] 19:50:20.418075 run osmo-hlr_10.42.42.2(pid=8579): stdout: | (launched: 2022-12-09_19:50:16.835117) 19:50:20.469479 run osmo-hlr_10.42.42.2(pid=8579): stderr: | [0;m[1;31m20221209195017142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195017142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195017142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195017142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195017143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195017143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195017162 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195017170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195017170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195017170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:20.521334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8574): Terminating (SIGTERM) 19:50:20.562552 run iperf3-srv_10.42.42.10(pid=8575): Terminating (SIGTERM) 19:50:20.603785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Terminating (SIGTERM) 19:50:20.645040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Terminating (SIGTERM) 19:50:20.686284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8584): Terminating (SIGTERM) 19:50:20.727379 --- ParallelTerminationStrategy: PID 8574 died... 19:50:20.747045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8574): Terminated: ok {rc=0} 19:50:20.793075 --- ParallelTerminationStrategy: PID 8575 died... 19:50:20.812452 run iperf3-srv_10.42.42.10(pid=8575): Terminated {rc=256} 19:50:20.858418 --- ParallelTerminationStrategy: PID 8578 died... 19:50:20.877595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Terminated: ok {rc=0} 19:50:20.923731 --- ParallelTerminationStrategy: PID 8581 died... 19:50:20.943025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Terminated: ok {rc=0} 19:50:20.989353 --- ParallelTerminationStrategy: PID 8584 died... 19:50:21.008663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8584): Terminated: ok {rc=0} 19:50:21.095960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:50:22.243124 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.255110 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:50:22.307620 tst iperf3m4.py: using LAC 23323 19:50:22.427777 tst iperf3m4.py: using RAC 118 19:50:22.548856 tst iperf3m4.py: using CellId 23323 19:50:22.669362 tst iperf3m4.py: using BVCI 23324 19:50:22.779583 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.790929 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.802274 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.813998 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.825738 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.837267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.848851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.860456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:22.872215 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:22.989543 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:23.111298 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:23.226983 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:23.346914 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:23.569246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:23.898076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8586): Launched 19:50:24.182587 run iperf3-srv_10.42.42.10(pid=8587): Launched 19:50:24.305152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:50:24.526520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:24.855622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8588): Launched 19:50:25.139210 run iperf3-srv_10.42.42.10(pid=8589): Launched 19:50:25.261337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:50:25.481832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:25.809511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8590): Launched 19:50:26.093609 run iperf3-srv_10.42.42.10(pid=8591): Launched 19:50:26.214923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:50:26.434636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:26.762156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8592): Launched 19:50:27.046358 run iperf3-srv_10.42.42.10(pid=8593): Launched 19:50:27.168262 tst iperf3m4.py:8: start network... 19:50:27.389107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:27.897202 run create_hlr_db(pid=8594): Launched 19:50:28.020793 bus /gobi_6: Setting Powered False 19:50:29.084927 run create_hlr_db(pid=8594): Terminated: ok {rc=0} 19:50:29.539262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8596): Launched 19:50:29.866132 run osmo-hlr_10.42.42.2(pid=8597): Launched 19:50:29.990315 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:30.553470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8599): Launched 19:50:30.881851 run osmo-stp_10.42.42.5(pid=8600): Launched 19:50:31.174719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:31.886212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8602): Launched 19:50:32.009724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:32.277089 run patchelf(pid=8603): Launched 19:50:32.463969 run osmo-stp_10.42.42.5(pid=8600): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8600)] 19:50:32.594433 run osmo-stp_10.42.42.5(pid=8600): stdout: | (launched: 2022-12-09_19:50:30.820596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:32.726131 run osmo-stp_10.42.42.5(pid=8600): stderr: | [0;m[38;5;43m20221209195031162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195031162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195031164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195031165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:32.857576 run osmo-stp_10.42.42.5(pid=8600): stdout: | (launched: 2022-12-09_19:50:30.820596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:32.983041 run osmo-stp_10.42.42.5(pid=8600): stderr: | [0;m[38;5;43m20221209195031162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195031162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195031164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195031165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195031167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:33.131425 run patchelf(pid=8603): Terminating (SIGINT) 19:50:33.303004 run patchelf(pid=8603): Terminated: ok {rc=0} 19:50:33.426628 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8600): Process ended prematurely: osmo-stp_10.42.42.5(pid=8600) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8600)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:50:33.436431 tst iperf3m4.py:8: Test FAILED (11.2 sec) 19:50:33.463737 run osmo-hlr_10.42.42.2(pid=8597): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8597)] 19:50:33.511441 run osmo-hlr_10.42.42.2(pid=8597): stdout: | (launched: 2022-12-09_19:50:29.806123) 19:50:33.560313 run osmo-hlr_10.42.42.2(pid=8597): stderr: | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195030006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195030018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195030026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195030026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195030026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:33.609600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8586): Terminating (SIGTERM) 19:50:33.648702 run iperf3-srv_10.42.42.10(pid=8587): Terminating (SIGTERM) 19:50:33.687675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8588): Terminating (SIGTERM) 19:50:33.726715 run iperf3-srv_10.42.42.10(pid=8589): Terminating (SIGTERM) 19:50:33.765678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8590): Terminating (SIGTERM) 19:50:33.804734 run iperf3-srv_10.42.42.10(pid=8591): Terminating (SIGTERM) 19:50:33.843843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8592): Terminating (SIGTERM) 19:50:33.882834 run iperf3-srv_10.42.42.10(pid=8593): Terminating (SIGTERM) 19:50:33.921791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8596): Terminating (SIGTERM) 19:50:33.961378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8599): Terminating (SIGTERM) 19:50:34.001354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8602): Terminating (SIGTERM) 19:50:34.041039 --- ParallelTerminationStrategy: PID 8586 died... 19:50:34.059493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8586): Terminated: ok {rc=0} 19:50:34.102922 --- ParallelTerminationStrategy: PID 8587 died... 19:50:34.121168 run iperf3-srv_10.42.42.10(pid=8587): Terminated {rc=256} 19:50:34.164643 --- ParallelTerminationStrategy: PID 8588 died... 19:50:34.183059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8588): Terminated: ok {rc=0} 19:50:34.226537 --- ParallelTerminationStrategy: PID 8589 died... 19:50:34.244927 run iperf3-srv_10.42.42.10(pid=8589): Terminated {rc=256} 19:50:34.288103 --- ParallelTerminationStrategy: PID 8590 died... 19:50:34.306497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8590): Terminated: ok {rc=0} 19:50:34.349689 --- ParallelTerminationStrategy: PID 8591 died... 19:50:34.368050 run iperf3-srv_10.42.42.10(pid=8591): Terminated {rc=256} 19:50:34.411236 --- ParallelTerminationStrategy: PID 8592 died... 19:50:34.429509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8592): Terminated: ok {rc=0} 19:50:34.472718 --- ParallelTerminationStrategy: PID 8593 died... 19:50:34.491064 run iperf3-srv_10.42.42.10(pid=8593): Terminated {rc=256} 19:50:34.534085 --- ParallelTerminationStrategy: PID 8596 died... 19:50:34.552557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8596): Terminated: ok {rc=0} 19:50:34.595825 --- ParallelTerminationStrategy: PID 8599 died... 19:50:34.614262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8599): Terminated: ok {rc=0} 19:50:34.657954 --- ParallelTerminationStrategy: PID 8602 died... 19:50:34.676262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8602): Terminated: ok {rc=0} 19:50:34.761886 bus /gobi_4: Setting Powered False 19:50:35.860677 bus /gobi_4: Setting Powered False 19:50:36.971874 bus /gobi_1: Setting Powered False 19:50:38.069120 bus /gobi_1: Setting Powered False 19:50:39.184005 bus /gobi_0: Setting Powered False 19:50:40.281038 bus /gobi_0: Setting Powered False 19:50:41.399057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:50:42.502053 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:42.514278 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:50:42.569365 tst ping.py: using LAC 23324 19:50:42.696389 tst ping.py: using RAC 119 19:50:42.821379 tst ping.py: using CellId 23324 19:50:42.948761 tst ping.py: using BVCI 23325 19:50:43.064752 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.076875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.088602 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.100663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.113107 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.125125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.137636 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:43.149871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:43.268344 tst ping.py:19: start network... 19:50:43.485167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:43.985766 run create_hlr_db(pid=8604): Launched 19:50:44.108239 bus /gobi_6: Setting Powered False 19:50:45.172566 run create_hlr_db(pid=8604): Terminated: ok {rc=0} 19:50:45.603498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Launched 19:50:45.916792 run osmo-hlr_10.42.42.2(pid=8607): Launched 19:50:46.099843 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:46.736179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Launched 19:50:47.060512 run osmo-stp_10.42.42.5(pid=8610): Launched 19:50:47.244254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:47.879921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Launched 19:50:47.994041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:48.248342 run patchelf(pid=8613): Launched 19:50:48.414679 run osmo-stp_10.42.42.5(pid=8610): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] 19:50:48.542155 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-09_19:50:46.999897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:48.670710 run osmo-stp_10.42.42.5(pid=8610): stderr: | [0;m[38;5;43m20221209195047340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195047341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195047341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195047341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:48.799149 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-09_19:50:46.999897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:48.922295 run osmo-stp_10.42.42.5(pid=8610): stderr: | [0;m[38;5;43m20221209195047340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195047341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195047341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195047341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195047342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:49.067763 run patchelf(pid=8613): Terminating (SIGINT) 19:50:49.235701 run patchelf(pid=8613): Terminated: ok {rc=0} 19:50:49.356733 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:50:49.365891 tst ping.py:22: Test FAILED (6.9 sec) 19:50:49.392463 run osmo-hlr_10.42.42.2(pid=8607): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8607)] 19:50:49.439852 run osmo-hlr_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-09_19:50:45.856707) 19:50:49.488851 run osmo-hlr_10.42.42.2(pid=8607): stderr: | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195046216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195046242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195046261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195046261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195046261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:49.538391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminating (SIGTERM) 19:50:49.577960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminating (SIGTERM) 19:50:49.617360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Terminating (SIGTERM) 19:50:49.657432 --- ParallelTerminationStrategy: PID 8606 died... 19:50:49.676369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminated: ok {rc=0} 19:50:49.720156 --- ParallelTerminationStrategy: PID 8609 died... 19:50:49.738691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminated: ok {rc=0} 19:50:49.782834 --- ParallelTerminationStrategy: PID 8612 died... 19:50:49.801480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Terminated: ok {rc=0} 19:50:49.887488 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:50:50.977175 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:50.989702 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:50:51.040911 tst ping_idle_ping.py: using LAC 23325 19:50:51.160263 tst ping_idle_ping.py: using RAC 120 19:50:51.277850 tst ping_idle_ping.py: using CellId 23325 19:50:51.398666 tst ping_idle_ping.py: using BVCI 23326 19:50:51.508491 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.520000 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.531223 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.542827 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.554064 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.565260 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.576395 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:50:51.587605 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:50:51.704091 tst ping_idle_ping.py:24: start network... 19:50:51.922899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:52.426377 run create_hlr_db(pid=8614): Launched 19:50:52.552146 bus /gobi_6: Setting Powered False 19:50:53.612347 run create_hlr_db(pid=8614): Terminated: ok {rc=0} 19:50:54.055109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8616): Launched 19:50:54.380313 run osmo-hlr_10.42.42.2(pid=8617): Launched 19:50:54.504029 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:55.061657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8619): Launched 19:50:55.384280 run osmo-stp_10.42.42.5(pid=8620): Launched 19:50:55.507518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:56.065580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8622): Launched 19:50:56.188393 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:56.461252 run patchelf(pid=8623): Launched 19:50:56.639654 run osmo-stp_10.42.42.5(pid=8620): ERR: Terminated: ERROR {rc=1} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8620)] 19:50:56.775759 run osmo-stp_10.42.42.5(pid=8620): stdout: | (launched: 2022-12-09_19:50:55.324666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:56.914034 run osmo-stp_10.42.42.5(pid=8620): stderr: | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195055517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:57.051839 run osmo-stp_10.42.42.5(pid=8620): stdout: | (launched: 2022-12-09_19:50:55.324666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:57.183466 run osmo-stp_10.42.42.5(pid=8620): stderr: | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195055516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195055517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195055517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:57.339635 run patchelf(pid=8623): Terminating (SIGINT) 19:50:57.518768 run patchelf(pid=8623): Terminated: ok {rc=0} 19:50:57.648357 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8620): Process ended prematurely: osmo-stp_10.42.42.5(pid=8620) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8620)] [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:50:57.658143 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:50:57.686873 run osmo-hlr_10.42.42.2(pid=8617): ERR: Terminated: ERROR {rc=237} [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8617)] 19:50:57.736696 run osmo-hlr_10.42.42.2(pid=8617): stdout: | (launched: 2022-12-09_19:50:54.320463) 19:50:57.788187 run osmo-hlr_10.42.42.2(pid=8617): stderr: | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195054519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195054533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195054541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195054541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195054541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:57.840472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8616): Terminating (SIGTERM) 19:50:57.882198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8619): Terminating (SIGTERM) 19:50:57.923780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8622): Terminating (SIGTERM) 19:50:57.965696 --- ParallelTerminationStrategy: PID 8616 died... 19:50:57.985381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8616): Terminated: ok {rc=0} 19:50:58.031441 --- ParallelTerminationStrategy: PID 8619 died... 19:50:58.050780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8619): Terminated: ok {rc=0} 19:50:58.096789 --- ParallelTerminationStrategy: PID 8622 died... 19:50:58.116539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8622): Terminated: ok {rc=0} 19:50:58.203517 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 19:50:59.524580 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:50:59.532781 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:50:59.567301 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:50:59.602406 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:50:59.658323 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:50:59.689812 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:50:59.723330 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:51:00.288426 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2363 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:51:00.293891 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.305830 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:51:00.378298 tst switch_tch_pdch.py: using LAC 23326 19:51:00.506175 tst switch_tch_pdch.py: using RAC 121 19:51:00.630181 tst switch_tch_pdch.py: using CellId 23326 19:51:00.753961 tst switch_tch_pdch.py: using BVCI 23327 19:51:00.887474 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.899906 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.924020 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.936596 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.948929 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.961761 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.974055 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:51:00.987024 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:51:01.118519 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:51:01.251454 tst switch_tch_pdch.py:51: start network... 19:51:01.460810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:01.947739 run create_hlr_db(pid=8627): Launched 19:51:02.108909 bus /gobi_6: Setting Powered False 19:51:03.168569 run create_hlr_db(pid=8627): Terminated: ok {rc=0} 19:51:03.588782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8629): Launched 19:51:03.889708 run osmo-hlr_10.42.42.2(pid=8630): Launched 19:51:04.004007 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:04.539533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8632): Launched 19:51:04.839864 run osmo-stp_10.42.42.5(pid=8633): Launched 19:51:04.953141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:05.472939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8635): Launched 19:51:05.587067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:05.840438 run patchelf(pid=8636): Launched 19:51:06.006787 run osmo-stp_10.42.42.5(pid=8633): ERR: Terminated: ERROR {rc=1} [trial-2363↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8633)] 19:51:06.133691 run osmo-stp_10.42.42.5(pid=8633): stdout: | (launched: 2022-12-09_19:51:04.784142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:06.261746 run osmo-stp_10.42.42.5(pid=8633): stderr: | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195104957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:06.389915 run osmo-stp_10.42.42.5(pid=8633): stdout: | (launched: 2022-12-09_19:51:04.784142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:06.512249 run osmo-stp_10.42.42.5(pid=8633): stderr: | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195104957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195104957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195104958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:06.657652 run patchelf(pid=8636): Terminating (SIGINT) 19:51:06.824898 run patchelf(pid=8636): Terminated: ok {rc=0} 19:51:06.946316 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8633): Process ended prematurely: osmo-stp_10.42.42.5(pid=8633) [trial-2363↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8633)] [trial-2363↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:51:06.955306 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 19:51:06.981464 run osmo-hlr_10.42.42.2(pid=8630): ERR: Terminated: ERROR {rc=237} [trial-2363↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8630)] 19:51:07.028626 run osmo-hlr_10.42.42.2(pid=8630): stdout: | (launched: 2022-12-09_19:51:03.833991) 19:51:07.077533 run osmo-hlr_10.42.42.2(pid=8630): stderr: | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195104013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195104025 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195104035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195104035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195104035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:07.126775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8629): Terminating (SIGTERM) 19:51:07.166177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8632): Terminating (SIGTERM) 19:51:07.205291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8635): Terminating (SIGTERM) 19:51:07.245138 --- ParallelTerminationStrategy: PID 8629 died... 19:51:07.263809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8629): Terminated: ok {rc=0} 19:51:07.307103 --- ParallelTerminationStrategy: PID 8632 died... 19:51:07.325348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8632): Terminated: ok {rc=0} 19:51:07.368468 --- ParallelTerminationStrategy: PID 8635 died... 19:51:07.386799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8635): Terminated: ok {rc=0} 19:51:07.471795 bus /gobi_0: Setting Powered False 19:51:08.571288 bus /gobi_0: Setting Powered False 19:51:09.683023 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2363 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 nitb_smpp --------------------------------------------------------------------- 19:51:10.940167 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:51:10.943491 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 19:51:10.965935 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 19:51:10.973014 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 19:51:11.008502 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 19:51:11.029705 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 19:51:11.036173 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 19:51:11.555094 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2363 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 19:51:11.560281 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:51:11.579222 tst esme_connect_policy_acceptall.py: using MSISDN 7345 19:51:11.724420 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:51:12.339094 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8641): Launched 19:51:12.669153 run osmo-nitb_10.42.42.2(pid=8642): Launched 19:51:12.850774 run osmo-nitb_10.42.42.2(pid=8642): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8642)] 19:51:12.997287 run osmo-nitb_10.42.42.2(pid=8642): stdout: | (launched: 2022-12-09_19:51:12.608172) 19:51:13.144782 run osmo-nitb_10.42.42.2(pid=8642): stderr: | (launched: 2022-12-09_19:51:12.657291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:13.292366 run osmo-nitb_10.42.42.2(pid=8642): stdout: | (launched: 2022-12-09_19:51:12.608172) 19:51:13.434143 run osmo-nitb_10.42.42.2(pid=8642): stderr: | (launched: 2022-12-09_19:51:12.657291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8642): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8642) [trial-2363↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8642)] 19:51:13.793200 tst osmo-nitb_10.42.42.2(pid=8642): stdout: | (launched: 2022-12-09_19:51:12.608172) 19:51:13.926663 tst osmo-nitb_10.42.42.2(pid=8642): stderr: | (launched: 2022-12-09_19:51:12.657291) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:14.083734 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=8642): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8642) [trial-2363↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8642)] [trial-2363↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 19:51:14.092696 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 19:51:14.099974 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8641): Terminating (SIGTERM) 19:51:14.310786 --- ParallelTerminationStrategy: PID 8641 died... 19:51:14.332363 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8641): Terminated: ok {rc=0} ---------------------------------------------- trial-2363 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 19:51:14.383433 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:51:14.404771 tst esme_connect_policy_closed.py: using MSISDN 7346 19:51:14.537117 tst esme_connect_policy_closed.py: using MSISDN 7347 19:51:14.656263 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:51:15.268832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8643): Launched 19:51:15.598716 run osmo-nitb_10.42.42.2(pid=8644): Launched 19:51:15.776608 run osmo-nitb_10.42.42.2(pid=8644): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8644)] 19:51:15.948338 run osmo-nitb_10.42.42.2(pid=8644): stdout: | (launched: 2022-12-09_19:51:15.538236) 19:51:16.086139 run osmo-nitb_10.42.42.2(pid=8644): stderr: | (launched: 2022-12-09_19:51:15.587350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:16.219638 run osmo-nitb_10.42.42.2(pid=8644): stdout: | (launched: 2022-12-09_19:51:15.538236) 19:51:16.349614 run osmo-nitb_10.42.42.2(pid=8644): stderr: | (launched: 2022-12-09_19:51:15.587350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:16.501465 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=8644): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8644) [trial-2363↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8644)] [trial-2363↪nitb_smpp↪esme_connect_policy_closed.py:24] 19:51:16.511114 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 19:51:16.518640 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8643): Terminating (SIGTERM) 19:51:16.732096 --- ParallelTerminationStrategy: PID 8643 died... 19:51:16.751261 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8643): Terminated: ok {rc=0} ---------------------------------------------- trial-2363 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 19:51:16.802516 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:51:16.814508 tst nitb_smpp: Using 1 x bts (candidates: 1) 19:51:16.850580 tst esme_ms_sms_storeforward.py: using LAC 23327 19:51:17.016466 tst esme_ms_sms_storeforward.py: using RAC 122 19:51:17.141784 tst esme_ms_sms_storeforward.py: using CellId 23327 19:51:17.267271 tst esme_ms_sms_storeforward.py: using BVCI 23328 19:51:17.385919 tst nitb_smpp: Using 1 x modem (candidates: 1) 19:51:17.513770 tst esme_ms_sms_storeforward.py: using MSISDN 7348 19:51:17.634603 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 19:51:17.859588 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:51:18.531950 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8645): Launched 19:51:18.842766 run osmo-nitb_10.42.42.2(pid=8646): Launched 19:51:19.008841 run osmo-nitb_10.42.42.2(pid=8646): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8646)] 19:51:19.135721 run osmo-nitb_10.42.42.2(pid=8646): stdout: | (launched: 2022-12-09_19:51:18.785498) 19:51:19.263216 run osmo-nitb_10.42.42.2(pid=8646): stderr: | (launched: 2022-12-09_19:51:18.831673) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:19.391224 run osmo-nitb_10.42.42.2(pid=8646): stdout: | (launched: 2022-12-09_19:51:18.785498) 19:51:19.514005 run osmo-nitb_10.42.42.2(pid=8646): stderr: | (launched: 2022-12-09_19:51:18.831673) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:19.660608 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=8646): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8646) [trial-2363↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8646)] [trial-2363↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 19:51:19.668910 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 19:51:19.675388 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8645): Terminating (SIGTERM) 19:51:19.883041 --- ParallelTerminationStrategy: PID 8645 died... 19:51:19.903485 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8645): Terminated: ok {rc=0} 19:51:19.988147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 19:51:21.075942 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:51:21.087037 tst nitb_smpp: Using 1 x bts (candidates: 1) 19:51:21.121752 tst esme_ms_sms_transaction.py: using LAC 23328 19:51:21.244128 tst esme_ms_sms_transaction.py: using RAC 123 19:51:21.366903 tst esme_ms_sms_transaction.py: using CellId 23328 19:51:21.489489 tst esme_ms_sms_transaction.py: using BVCI 23329 19:51:21.601253 tst nitb_smpp: Using 1 x modem (candidates: 1) 19:51:21.730772 tst esme_ms_sms_transaction.py: using MSISDN 7349 19:51:21.852317 tst esme_ms_sms_transaction.py:18: start nitb and bts... 19:51:22.077390 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:51:22.748455 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8647): Launched 19:51:23.080385 run osmo-nitb_10.42.42.2(pid=8648): Launched 19:51:23.263436 run osmo-nitb_10.42.42.2(pid=8648): ERR: Terminated: ERROR {rc=2} [trial-2363↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8648)] 19:51:23.410307 run osmo-nitb_10.42.42.2(pid=8648): stdout: | (launched: 2022-12-09_19:51:23.019720) 19:51:23.558671 run osmo-nitb_10.42.42.2(pid=8648): stderr: | (launched: 2022-12-09_19:51:23.069017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:23.707112 run osmo-nitb_10.42.42.2(pid=8648): stdout: | (launched: 2022-12-09_19:51:23.019720) 19:51:23.849972 run osmo-nitb_10.42.42.2(pid=8648): stderr: | (launched: 2022-12-09_19:51:23.069017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe189f60268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8648) [trial-2363↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8648)] 19:51:24.205952 tst osmo-nitb_10.42.42.2(pid=8648): stdout: | (launched: 2022-12-09_19:51:23.019720) 19:51:24.339459 tst osmo-nitb_10.42.42.2(pid=8648): stderr: | (launched: 2022-12-09_19:51:23.069017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:51:24.497281 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=8648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8648) [trial-2363↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8648)] [trial-2363↪nitb_smpp↪esme_ms_sms_transaction.py:21] 19:51:24.506511 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 19:51:24.513606 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8647): Terminating (SIGTERM) 19:51:24.724855 --- ParallelTerminationStrategy: PID 8647 died... 19:51:24.746403 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8647): Terminated: ok {rc=0} 19:51:24.835306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 smpp --------------------------------------------------------------------- 19:51:26.005396 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:51:26.008156 tst smpp: Verifying 1 x bts (candidates: 11) 19:51:26.029336 tst smpp: Verifying 6 x ip_address (candidates: 9) 19:51:26.057479 tst smpp: Verifying 1 x modem (candidates: 12) 19:51:26.096796 tst smpp: Reserving 1 x bts (candidates: 11) 19:51:26.118542 tst smpp: Reserving 6 x ip_address (candidates: 9) 19:51:26.146377 tst smpp: Reserving 1 x modem (candidates: 12) 19:51:26.669540 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 19:51:26.674727 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:26.685489 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:26.695991 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:26.708225 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:26.726885 tst esme_connect_policy_acceptall.py: using MSISDN 7350 19:51:26.849922 run osmo-stp_10.42.42.4: Starting osmo-stp 19:51:27.412328 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8653): Launched 19:51:27.743226 run osmo-stp_10.42.42.4(pid=8654): Launched 19:51:27.869549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:28.382936 run create_hlr_db(pid=8655): Launched 19:51:28.509183 bus /sierra_2: Setting Powered False 19:51:29.573750 run create_hlr_db(pid=8655): Terminated: ok {rc=0} 19:51:30.032911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Launched 19:51:30.362590 run osmo-hlr_10.42.42.2(pid=8658): Launched 19:51:30.489963 run osmo-msc_10.42.42.5: Starting osmo-msc 19:51:31.133187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Launched 19:51:31.484781 run osmo-msc_10.42.42.5(pid=8661): Launched 19:51:31.869147 run osmo-hlr_10.42.42.2(pid=8658): ERR: Terminated: ERROR {rc=237} [trial-2363↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8658)] 19:51:32.165122 run osmo-hlr_10.42.42.2(pid=8658): stdout: | (launched: 2022-12-09_19:51:30.302224) 19:51:32.305207 run osmo-hlr_10.42.42.2(pid=8658): stderr: | [0;m[1;31m20221209195130496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195130510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:32.443751 run osmo-hlr_10.42.42.2(pid=8658): stdout: | (launched: 2022-12-09_19:51:30.302224) 19:51:32.576477 run osmo-hlr_10.42.42.2(pid=8658): stderr: | [0;m[1;31m20221209195130496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195130497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195130510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195130519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:32.734699 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=8658): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8658) [trial-2363↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8658)] [trial-2363↪smpp↪esme_connect_policy_acceptall.py:23] 19:51:32.743701 tst esme_connect_policy_acceptall.py:23: Test FAILED (6.1 sec) 19:51:32.771425 run osmo-msc_10.42.42.5(pid=8661): ERR: Terminated: ERROR {rc=9} [trial-2363↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=8661)] 19:51:32.821878 run osmo-msc_10.42.42.5(pid=8661): stdout: | (launched: 2022-12-09_19:51:31.421520) 19:51:32.874177 run osmo-msc_10.42.42.5(pid=8661): stderr: | [0;m[38;5;43m20221209195131953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209195131953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209195131953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209195131953 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209195131953 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209195131953 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209195131953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209195131954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209195131954 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 19:51:32.926657 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8653): Terminating (SIGTERM) 19:51:32.968507 run osmo-stp_10.42.42.4(pid=8654): Terminating (SIGTERM) 19:51:33.010374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Terminating (SIGTERM) 19:51:33.053197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Terminating (SIGTERM) 19:51:33.096565 --- ParallelTerminationStrategy: PID 8653 died... 19:51:33.117104 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8653): Terminated: ok {rc=0} 19:51:33.165931 --- ParallelTerminationStrategy: PID 8654 died... 19:51:33.185392 run osmo-stp_10.42.42.4(pid=8654): Terminated: ok {rc=0} 19:51:33.231778 --- ParallelTerminationStrategy: PID 8657 died... 19:51:33.251193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Terminated: ok {rc=0} 19:51:33.297676 --- ParallelTerminationStrategy: PID 8660 died... 19:51:33.317089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Terminated: ok {rc=0} ---------------------------------------------- trial-2363 smpp esme_connect_policy_closed.py ---------------------------------------------- 19:51:33.368543 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:33.380060 tst smpp: Using 1 x bts (candidates: 1) 19:51:33.417077 tst esme_connect_policy_closed.py: using LAC 23329 19:51:33.546834 tst esme_connect_policy_closed.py: using RAC 124 19:51:33.677557 tst esme_connect_policy_closed.py: using CellId 23329 19:51:33.799936 tst esme_connect_policy_closed.py: using BVCI 23330 19:51:33.914205 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:33.924752 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:33.937627 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:33.958816 tst esme_connect_policy_closed.py: using MSISDN 7351 19:51:34.081541 tst esme_connect_policy_closed.py: using MSISDN 7352 19:51:34.193689 run osmo-stp_10.42.42.4: Starting osmo-stp 19:51:34.721144 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8664): Launched 19:51:35.030320 run osmo-stp_10.42.42.4(pid=8665): Launched 19:51:35.147979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:35.629485 run create_hlr_db(pid=8666): Launched 19:51:36.810057 run create_hlr_db(pid=8666): Terminated: ok {rc=0} 19:51:37.135888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Launched 19:51:37.446461 run osmo-hlr_10.42.42.2(pid=8669): Launched 19:51:37.565049 run osmo-msc_10.42.42.5: Starting osmo-msc 19:51:38.141743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Launched 19:51:38.452278 run osmo-msc_10.42.42.5(pid=8672): Launched 19:51:38.625181 run osmo-hlr_10.42.42.2(pid=8669): ERR: Terminated: ERROR {rc=237} [trial-2363↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8669)] 19:51:38.757570 run osmo-hlr_10.42.42.2(pid=8669): stdout: | (launched: 2022-12-09_19:51:37.388606) 19:51:38.888299 run osmo-hlr_10.42.42.2(pid=8669): stderr: | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195137577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195137585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195137586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195137586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:39.017669 run osmo-hlr_10.42.42.2(pid=8669): stdout: | (launched: 2022-12-09_19:51:37.388606) 19:51:39.141219 run osmo-hlr_10.42.42.2(pid=8669): stderr: | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195137565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195137577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195137585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195137586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195137586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:39.288905 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=8669): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8669) [trial-2363↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8669)] [trial-2363↪smpp↪esme_connect_policy_closed.py:31] 19:51:39.297474 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 19:51:39.323284 run osmo-msc_10.42.42.5(pid=8672): ERR: Terminated: ERROR {rc=9} [trial-2363↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=8672)] 19:51:39.370728 run osmo-msc_10.42.42.5(pid=8672): stdout: | (launched: 2022-12-09_19:51:38.394675) 19:51:39.419402 run osmo-msc_10.42.42.5(pid=8672): stderr: | [0;m[38;5;43m20221209195138717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209195138717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209195138717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209195138717 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209195138717 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209195138717 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209195138717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209195138718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209195138718 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 19:51:39.468282 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8664): Terminating (SIGTERM) 19:51:39.507546 run osmo-stp_10.42.42.4(pid=8665): Terminating (SIGTERM) 19:51:39.546698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Terminating (SIGTERM) 19:51:39.587542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Terminating (SIGTERM) 19:51:39.628146 --- ParallelTerminationStrategy: PID 8664 died... 19:51:39.647105 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8664): Terminated: ok {rc=0} 19:51:39.690772 --- ParallelTerminationStrategy: PID 8665 died... 19:51:39.709285 run osmo-stp_10.42.42.4(pid=8665): Terminated: ok {rc=0} 19:51:39.752572 --- ParallelTerminationStrategy: PID 8668 died... 19:51:39.771109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Terminated: ok {rc=0} 19:51:39.814381 --- ParallelTerminationStrategy: PID 8671 died... 19:51:39.832832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Terminated: ok {rc=0} ---------------------------------------------- trial-2363 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 19:51:39.880664 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:39.891727 tst smpp: Using 1 x bts (candidates: 1) 19:51:39.926798 tst esme_ms_sms_storeforward.py: using LAC 23330 19:51:40.063994 tst esme_ms_sms_storeforward.py: using RAC 125 19:51:40.185681 tst esme_ms_sms_storeforward.py: using CellId 23330 19:51:40.308822 tst esme_ms_sms_storeforward.py: using BVCI 23331 19:51:40.422757 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:40.433376 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:40.443633 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:40.454058 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:40.464168 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:40.474324 tst smpp: Using 1 x modem (candidates: 1) 19:51:40.607212 tst esme_ms_sms_storeforward.py: using MSISDN 7353 19:51:40.729132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:41.243234 run create_hlr_db(pid=8675): Launched 19:51:42.428322 run create_hlr_db(pid=8675): Terminated: ok {rc=0} 19:51:42.776935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8677): Launched 19:51:43.108648 run osmo-hlr_10.42.42.2(pid=8678): Launched 19:51:43.235194 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:43.813331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8680): Launched 19:51:44.146466 run osmo-stp_10.42.42.5(pid=8681): Launched 19:51:44.273593 run osmo-msc_10.42.42.6: Starting osmo-msc 19:51:44.873680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8683): Launched 19:51:45.206785 run osmo-msc_10.42.42.6(pid=8684): Launched 19:51:45.391432 run osmo-stp_10.42.42.5(pid=8681): ERR: Terminated: ERROR {rc=1} [trial-2363↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8681)] 19:51:45.531005 run osmo-stp_10.42.42.5(pid=8681): stdout: | (launched: 2022-12-09_19:51:44.084602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:45.671426 run osmo-stp_10.42.42.5(pid=8681): stderr: | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195144278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:45.809702 run osmo-stp_10.42.42.5(pid=8681): stdout: | (launched: 2022-12-09_19:51:44.084602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:45.945458 run osmo-stp_10.42.42.5(pid=8681): stderr: | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195144278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195144278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195144281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:46.107654 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=8681): Process ended prematurely: osmo-stp_10.42.42.5(pid=8681) [trial-2363↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8681)] [trial-2363↪smpp↪esme_ms_sms_storeforward.py:30] 19:51:46.117726 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 19:51:46.148702 run osmo-hlr_10.42.42.2(pid=8678): ERR: Terminated: ERROR {rc=237} [trial-2363↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8678)] 19:51:46.200892 run osmo-hlr_10.42.42.2(pid=8678): stdout: | (launched: 2022-12-09_19:51:43.048012) 19:51:46.254516 run osmo-hlr_10.42.42.2(pid=8678): stderr: | [0;m[1;31m20221209195143250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195143250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195143251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195143251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195143251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195143251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195143263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195143271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195143271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195143271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:46.328853 run osmo-msc_10.42.42.6(pid=8684): ERR: Terminated: ERROR {rc=2} [trial-2363↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8684)] 19:51:46.381287 run osmo-msc_10.42.42.6(pid=8684): stdout: | (launched: 2022-12-09_19:51:45.145606) 19:51:46.435317 run osmo-msc_10.42.42.6(pid=8684): stderr: | [0;m[38;5;43m20221209195145468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195145469 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa19ccdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195145469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195145469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195145469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195145469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195145471 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195145471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195145472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195145472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:51:46.489686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8677): Terminating (SIGTERM) 19:51:46.534069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8680): Terminating (SIGTERM) 19:51:46.578984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8683): Terminating (SIGTERM) 19:51:46.623115 --- ParallelTerminationStrategy: PID 8677 died... 19:51:46.643851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8677): Terminated: ok {rc=0} 19:51:46.693064 --- ParallelTerminationStrategy: PID 8680 died... 19:51:46.713385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8680): Terminated: ok {rc=0} 19:51:46.762283 --- ParallelTerminationStrategy: PID 8683 died... 19:51:46.782483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8683): Terminated: ok {rc=0} 19:51:46.873253 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 smpp esme_ms_sms_transaction.py ---------------------------------------------- 19:51:47.963081 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:47.975047 tst smpp: Using 1 x bts (candidates: 1) 19:51:48.016579 tst esme_ms_sms_transaction.py: using LAC 23331 19:51:48.140233 tst esme_ms_sms_transaction.py: using RAC 126 19:51:48.262887 tst esme_ms_sms_transaction.py: using CellId 23331 19:51:48.385390 tst esme_ms_sms_transaction.py: using BVCI 23332 19:51:48.496369 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:48.506870 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:48.517269 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:48.527454 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:48.537700 tst smpp: Using 1 x ip_address (candidates: 6) 19:51:48.547841 tst smpp: Using 1 x modem (candidates: 1) 19:51:48.679875 tst esme_ms_sms_transaction.py: using MSISDN 7354 19:51:48.793571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:49.273255 run create_hlr_db(pid=8686): Launched 19:51:49.399246 bus /sierra_2: Setting Powered False 19:51:50.460478 run create_hlr_db(pid=8686): Terminated: ok {rc=0} 19:51:50.914671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Launched 19:51:51.248102 run osmo-hlr_10.42.42.2(pid=8689): Launched 19:51:51.375506 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:51.947105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Launched 19:51:52.278775 run osmo-stp_10.42.42.5(pid=8692): Launched 19:51:52.406326 run osmo-msc_10.42.42.6: Starting osmo-msc 19:51:53.006092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Launched 19:51:53.339061 run osmo-msc_10.42.42.6(pid=8695): Launched 19:51:53.524459 run osmo-stp_10.42.42.5(pid=8692): ERR: Terminated: ERROR {rc=1} [trial-2363↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] 19:51:53.664004 run osmo-stp_10.42.42.5(pid=8692): stdout: | (launched: 2022-12-09_19:51:52.218267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:53.803871 run osmo-stp_10.42.42.5(pid=8692): stderr: | [0;m[38;5;43m20221209195152412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195152412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195152413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195152413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:53.936091 run osmo-stp_10.42.42.5(pid=8692): stdout: | (launched: 2022-12-09_19:51:52.218267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:54.060070 run osmo-stp_10.42.42.5(pid=8692): stderr: | [0;m[38;5;43m20221209195152412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195152412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195152413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195152413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195152414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:54.207961 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=8692): Process ended prematurely: osmo-stp_10.42.42.5(pid=8692) [trial-2363↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] [trial-2363↪smpp↪esme_ms_sms_transaction.py:28] 19:51:54.216381 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 19:51:54.242837 run osmo-hlr_10.42.42.2(pid=8689): ERR: Terminated: ERROR {rc=237} [trial-2363↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8689)] 19:51:54.290765 run osmo-hlr_10.42.42.2(pid=8689): stdout: | (launched: 2022-12-09_19:51:51.186693) 19:51:54.339978 run osmo-hlr_10.42.42.2(pid=8689): stderr: | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195151387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195151399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195151409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195151410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195151410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:54.408754 run osmo-msc_10.42.42.6(pid=8695): ERR: Terminated: ERROR {rc=2} [trial-2363↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8695)] 19:51:54.456320 run osmo-msc_10.42.42.6(pid=8695): stdout: | (launched: 2022-12-09_19:51:53.276835) 19:51:54.505924 run osmo-msc_10.42.42.6(pid=8695): stderr: | [0;m[38;5;43m20221209195153602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195153602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff55cff6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195153602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195153602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195153602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195153602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195153604 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195153604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195153605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195153605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:51:54.555519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Terminating (SIGTERM) 19:51:54.595102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Terminating (SIGTERM) 19:51:54.634822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Terminating (SIGTERM) 19:51:54.675140 --- ParallelTerminationStrategy: PID 8688 died... 19:51:54.694379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Terminated: ok {rc=0} 19:51:54.738927 --- ParallelTerminationStrategy: PID 8691 died... 19:51:54.757759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Terminated: ok {rc=0} 19:51:54.801820 --- ParallelTerminationStrategy: PID 8694 died... 19:51:54.820772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Terminated: ok {rc=0} 19:51:54.905632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 encryption --------------------------------------------------------------------- 19:51:56.100608 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:51:56.104111 tst encryption: Verifying 1 x bts (candidates: 11) 19:51:56.126188 tst encryption: Verifying 6 x ip_address (candidates: 9) 19:51:56.155304 tst encryption: Verifying 1 x modem (candidates: 12) 19:51:56.191335 tst encryption: Reserving 1 x bts (candidates: 11) 19:51:56.212558 tst encryption: Reserving 6 x ip_address (candidates: 9) 19:51:56.239494 tst encryption: Reserving 1 x modem (candidates: 12) 19:51:56.768556 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2363 encryption register_a5_0_authopt.py ---------------------------------------------- 19:51:56.825463 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:56.836646 tst encryption: Using 1 x bts (candidates: 1) 19:51:56.873190 tst register_a5_0_authopt.py: using LAC 23332 19:51:57.005735 tst register_a5_0_authopt.py: using RAC 127 19:51:57.135874 tst register_a5_0_authopt.py: using CellId 23332 19:51:57.259438 tst register_a5_0_authopt.py: using BVCI 23333 19:51:57.374243 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:57.385229 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:57.395652 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:57.406079 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:57.416459 tst encryption: Using 1 x ip_address (candidates: 6) 19:51:57.426711 tst encryption: Using 1 x modem (candidates: 1) 19:51:57.545594 tst register_a5_0_authopt.py:8: start network... 19:51:57.773182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:58.294244 run create_hlr_db(pid=8700): Launched 19:51:58.424539 bus /sierra_2: Setting Powered False 19:51:59.490263 run create_hlr_db(pid=8700): Terminated: ok {rc=0} 19:51:59.937204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Launched 19:52:00.250984 run osmo-hlr_10.42.42.2(pid=8703): Launched 19:52:00.370974 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:00.929715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Launched 19:52:01.283363 run osmo-stp_10.42.42.5(pid=8706): Launched 19:52:01.564405 run osmo-msc_10.42.42.6: Starting osmo-msc 19:52:02.220002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Launched 19:52:02.561736 run osmo-msc_10.42.42.6(pid=8709): Launched 19:52:02.750428 run osmo-stp_10.42.42.5(pid=8706): ERR: Terminated: ERROR {rc=1} [trial-2363↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] 19:52:02.892058 run osmo-stp_10.42.42.5(pid=8706): stdout: | (launched: 2022-12-09_19:52:01.222103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:03.033553 run osmo-stp_10.42.42.5(pid=8706): stderr: | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195201430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:03.173642 run osmo-stp_10.42.42.5(pid=8706): stdout: | (launched: 2022-12-09_19:52:01.222103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:03.307279 run osmo-stp_10.42.42.5(pid=8706): stderr: | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195201429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195201430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195201430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:03.467526 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8706): Process ended prematurely: osmo-stp_10.42.42.5(pid=8706) [trial-2363↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] [trial-2363↪encryption↪register_a5_0_authopt.py:8] 19:52:03.477476 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 19:52:03.505294 run osmo-hlr_10.42.42.2(pid=8703): ERR: Terminated: ERROR {rc=237} [trial-2363↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8703)] 19:52:03.555549 run osmo-hlr_10.42.42.2(pid=8703): stdout: | (launched: 2022-12-09_19:52:00.193386) 19:52:03.607648 run osmo-hlr_10.42.42.2(pid=8703): stderr: | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195200373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195200385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195200393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195200394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195200394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:03.679245 run osmo-msc_10.42.42.6(pid=8709): ERR: Terminated: ERROR {rc=2} [trial-2363↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8709)] 19:52:03.729591 run osmo-msc_10.42.42.6(pid=8709): stdout: | (launched: 2022-12-09_19:52:02.500395) 19:52:03.781253 run osmo-msc_10.42.42.6(pid=8709): stderr: | [0;m[38;5;43m20221209195202825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195202825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4c6a589c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195202825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195202825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195202825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195202826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195202827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195202828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195202828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195202828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:52:03.833258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Terminating (SIGTERM) 19:52:03.875207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Terminating (SIGTERM) 19:52:03.917077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Terminating (SIGTERM) 19:52:03.959054 --- ParallelTerminationStrategy: PID 8702 died... 19:52:03.978832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Terminated: ok {rc=0} 19:52:04.025278 --- ParallelTerminationStrategy: PID 8705 died... 19:52:04.044754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Terminated: ok {rc=0} 19:52:04.091616 --- ParallelTerminationStrategy: PID 8708 died... 19:52:04.111272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Terminated: ok {rc=0} 19:52:04.199272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 encryption register_a5_0_authreq.py ---------------------------------------------- 19:52:05.353277 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.365176 tst encryption: Using 1 x bts (candidates: 1) 19:52:05.401996 tst register_a5_0_authreq.py: using LAC 23333 19:52:05.532413 tst register_a5_0_authreq.py: using RAC 128 19:52:05.664687 tst register_a5_0_authreq.py: using CellId 23333 19:52:05.794629 tst register_a5_0_authreq.py: using BVCI 23334 19:52:05.918447 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.929471 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.940252 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.951291 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.962382 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:05.973451 tst encryption: Using 1 x modem (candidates: 1) 19:52:06.096008 tst register_a5_0_authreq.py:8: start network... 19:52:06.325472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:06.846756 run create_hlr_db(pid=8711): Launched 19:52:06.977602 bus /sierra_2: Setting Powered False 19:52:08.044004 run create_hlr_db(pid=8711): Terminated: ok {rc=0} 19:52:08.492354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8713): Launched 19:52:08.806675 run osmo-hlr_10.42.42.2(pid=8714): Launched 19:52:08.925910 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:09.464339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8716): Launched 19:52:09.777522 run osmo-stp_10.42.42.5(pid=8717): Launched 19:52:09.897438 run osmo-msc_10.42.42.6: Starting osmo-msc 19:52:10.462701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8719): Launched 19:52:10.776903 run osmo-msc_10.42.42.6(pid=8720): Launched 19:52:10.952772 run osmo-stp_10.42.42.5(pid=8717): ERR: Terminated: ERROR {rc=1} [trial-2363↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8717)] 19:52:11.085238 run osmo-stp_10.42.42.5(pid=8717): stdout: | (launched: 2022-12-09_19:52:09.719948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:11.216683 run osmo-stp_10.42.42.5(pid=8717): stderr: | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195209893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:11.346443 run osmo-stp_10.42.42.5(pid=8717): stdout: | (launched: 2022-12-09_19:52:09.719948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:11.470618 run osmo-stp_10.42.42.5(pid=8717): stderr: | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195209892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195209893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:11.619489 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8717): Process ended prematurely: osmo-stp_10.42.42.5(pid=8717) [trial-2363↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8717)] [trial-2363↪encryption↪register_a5_0_authreq.py:8] 19:52:11.628322 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 19:52:11.654329 run osmo-hlr_10.42.42.2(pid=8714): ERR: Terminated: ERROR {rc=237} [trial-2363↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8714)] 19:52:11.701490 run osmo-hlr_10.42.42.2(pid=8714): stdout: | (launched: 2022-12-09_19:52:08.748842) 19:52:11.750402 run osmo-hlr_10.42.42.2(pid=8714): stderr: | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195208926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195208939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195208947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195208947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195208947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:11.818653 run osmo-msc_10.42.42.6(pid=8720): ERR: Terminated: ERROR {rc=2} [trial-2363↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8720)] 19:52:11.866066 run osmo-msc_10.42.42.6(pid=8720): stdout: | (launched: 2022-12-09_19:52:10.718587) 19:52:11.914785 run osmo-msc_10.42.42.6(pid=8720): stderr: | [0;m[38;5;43m20221209195210995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195210995 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98fcf2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195210995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195210995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195210995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195210996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195210997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195210998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195210998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195210998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:52:11.963661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8713): Terminating (SIGTERM) 19:52:12.002987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8716): Terminating (SIGTERM) 19:52:12.042433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8719): Terminating (SIGTERM) 19:52:12.081941 --- ParallelTerminationStrategy: PID 8713 died... 19:52:12.100604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8713): Terminated: ok {rc=0} 19:52:12.144262 --- ParallelTerminationStrategy: PID 8716 died... 19:52:12.162787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8716): Terminated: ok {rc=0} 19:52:12.206536 --- ParallelTerminationStrategy: PID 8719 died... 19:52:12.225002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8719): Terminated: ok {rc=0} 19:52:12.309508 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 encryption register_a5_1_authreq.py ---------------------------------------------- 19:52:13.457747 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:13.468851 tst encryption: Using 1 x bts (candidates: 1) 19:52:13.505378 tst register_a5_1_authreq.py: using LAC 23334 19:52:13.629437 tst register_a5_1_authreq.py: using RAC 129 19:52:13.753730 tst register_a5_1_authreq.py: using CellId 23334 19:52:13.878503 tst register_a5_1_authreq.py: using BVCI 23335 19:52:13.993912 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:14.004260 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:14.014970 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:14.025472 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:14.035672 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:14.046048 tst encryption: Using 1 x modem (candidates: 1) 19:52:14.164588 tst register_a5_1_authreq.py:8: start network... 19:52:14.394352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:14.916733 run create_hlr_db(pid=8722): Launched 19:52:15.045947 bus /sierra_2: Setting Powered False 19:52:16.110753 run create_hlr_db(pid=8722): Terminated: ok {rc=0} 19:52:16.589649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Launched 19:52:16.947176 run osmo-hlr_10.42.42.2(pid=8725): Launched 19:52:17.194263 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:17.787769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Launched 19:52:18.126751 run osmo-stp_10.42.42.5(pid=8728): Launched 19:52:18.257600 run osmo-msc_10.42.42.6: Starting osmo-msc 19:52:18.864863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Launched 19:52:19.202480 run osmo-msc_10.42.42.6(pid=8731): Launched 19:52:19.390723 run osmo-stp_10.42.42.5(pid=8728): ERR: Terminated: ERROR {rc=1} [trial-2363↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] 19:52:19.532443 run osmo-stp_10.42.42.5(pid=8728): stdout: | (launched: 2022-12-09_19:52:18.065464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:19.674728 run osmo-stp_10.42.42.5(pid=8728): stderr: | [0;m[38;5;43m20221209195218260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195218260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195218261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195218261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:19.815451 run osmo-stp_10.42.42.5(pid=8728): stdout: | (launched: 2022-12-09_19:52:18.065464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:19.950613 run osmo-stp_10.42.42.5(pid=8728): stderr: | [0;m[38;5;43m20221209195218260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195218260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195218261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195218261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195218262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:20.111576 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8728): Process ended prematurely: osmo-stp_10.42.42.5(pid=8728) [trial-2363↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] [trial-2363↪encryption↪register_a5_1_authreq.py:8] 19:52:20.121295 tst register_a5_1_authreq.py:8: Test FAILED (6.7 sec) 19:52:20.149600 run osmo-hlr_10.42.42.2(pid=8725): ERR: Terminated: ERROR {rc=237} [trial-2363↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8725)] 19:52:20.199839 run osmo-hlr_10.42.42.2(pid=8725): stdout: | (launched: 2022-12-09_19:52:16.881954) 19:52:20.251861 run osmo-hlr_10.42.42.2(pid=8725): stderr: | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195217100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195217120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195217120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195217120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:20.324305 run osmo-msc_10.42.42.6(pid=8731): ERR: Terminated: ERROR {rc=2} [trial-2363↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8731)] 19:52:20.374621 run osmo-msc_10.42.42.6(pid=8731): stdout: | (launched: 2022-12-09_19:52:19.140811) 19:52:20.426518 run osmo-msc_10.42.42.6(pid=8731): stderr: | [0;m[38;5;43m20221209195219465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195219465 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e2796dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195219465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195219465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195219465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195219466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195219467 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195219468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195219468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195219468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:52:20.478647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Terminating (SIGTERM) 19:52:20.520412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Terminating (SIGTERM) 19:52:20.562350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Terminating (SIGTERM) 19:52:20.604536 --- ParallelTerminationStrategy: PID 8724 died... 19:52:20.624602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Terminated: ok {rc=0} 19:52:20.671294 --- ParallelTerminationStrategy: PID 8727 died... 19:52:20.690701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Terminated: ok {rc=0} 19:52:20.737368 --- ParallelTerminationStrategy: PID 8730 died... 19:52:20.756809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Terminated: ok {rc=0} 19:52:20.844764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2363 encryption register_a5_3_authreq.py ---------------------------------------------- 19:52:21.994605 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.005939 tst encryption: Using 1 x bts (candidates: 1) 19:52:22.042090 tst register_a5_3_authreq.py: using LAC 23335 19:52:22.165141 tst register_a5_3_authreq.py: using RAC 130 19:52:22.289630 tst register_a5_3_authreq.py: using CellId 23335 19:52:22.423325 tst register_a5_3_authreq.py: using BVCI 23336 19:52:22.546523 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.557755 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.569136 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.580426 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.591563 tst encryption: Using 1 x ip_address (candidates: 6) 19:52:22.602700 tst encryption: Using 1 x modem (candidates: 1) 19:52:22.729332 tst register_a5_3_authreq.py:8: start network... 19:52:22.941996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:23.425725 run create_hlr_db(pid=8733): Launched 19:52:23.554698 bus /sierra_2: Setting Powered False 19:52:24.619979 run create_hlr_db(pid=8733): Terminated: ok {rc=0} 19:52:25.066623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Launched 19:52:25.382094 run osmo-hlr_10.42.42.2(pid=8736): Launched 19:52:25.501684 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:26.043391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Launched 19:52:26.356856 run osmo-stp_10.42.42.5(pid=8739): Launched 19:52:26.476601 run osmo-msc_10.42.42.6: Starting osmo-msc 19:52:27.044142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8741): Launched 19:52:27.358352 run osmo-msc_10.42.42.6(pid=8742): Launched 19:52:27.536669 run osmo-stp_10.42.42.5(pid=8739): ERR: Terminated: ERROR {rc=1} [trial-2363↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] 19:52:27.669491 run osmo-stp_10.42.42.5(pid=8739): stdout: | (launched: 2022-12-09_19:52:26.299455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:27.801241 run osmo-stp_10.42.42.5(pid=8739): stderr: | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195226474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:27.931197 run osmo-stp_10.42.42.5(pid=8739): stdout: | (launched: 2022-12-09_19:52:26.299455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:28.056038 run osmo-stp_10.42.42.5(pid=8739): stderr: | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195226473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195226474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195226474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:28.205354 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8739): Process ended prematurely: osmo-stp_10.42.42.5(pid=8739) [trial-2363↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] [trial-2363↪encryption↪register_a5_3_authreq.py:8] 19:52:28.214262 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 19:52:28.240106 run osmo-hlr_10.42.42.2(pid=8736): ERR: Terminated: ERROR {rc=237} [trial-2363↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8736)] 19:52:28.287041 run osmo-hlr_10.42.42.2(pid=8736): stdout: | (launched: 2022-12-09_19:52:25.324446) 19:52:28.335511 run osmo-hlr_10.42.42.2(pid=8736): stderr: | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195225502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195225515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195225523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195225523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195225523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:28.403227 run osmo-msc_10.42.42.6(pid=8742): ERR: Terminated: ERROR {rc=2} [trial-2363↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8742)] 19:52:28.450122 run osmo-msc_10.42.42.6(pid=8742): stdout: | (launched: 2022-12-09_19:52:27.300657) 19:52:28.498438 run osmo-msc_10.42.42.6(pid=8742): stderr: | [0;m[38;5;43m20221209195227574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195227574 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25cfc2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195227575 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195227575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195227575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195227575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195227577 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195227577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195227577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195227577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:52:28.547268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Terminating (SIGTERM) 19:52:28.586198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Terminating (SIGTERM) 19:52:28.625323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8741): Terminating (SIGTERM) 19:52:28.665188 --- ParallelTerminationStrategy: PID 8735 died... 19:52:28.683663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Terminated: ok {rc=0} 19:52:28.727051 --- ParallelTerminationStrategy: PID 8738 died... 19:52:28.745326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Terminated: ok {rc=0} 19:52:28.788767 --- ParallelTerminationStrategy: PID 8741 died... 19:52:28.807040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8741): Terminated: ok {rc=0} 19:52:28.891646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 19:52:30.102380 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:52:30.107873 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 19:52:30.127062 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 19:52:30.156009 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 19:52:30.187407 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 19:52:30.206284 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 19:52:30.233711 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 19:52:30.743504 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 19:52:30.749039 tst handover.py:11: TEST_CONFIG: {} 19:52:30.987002 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:52:31.003953 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:52:31.028265 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:52:31.079268 tst handover.py: using MSISDN 7355 19:52:31.204695 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7355', subscriber_id=0} 19:52:31.325736 run srsepc_10.42.42.118: Starting srsepc 19:52:33.268017 run rm-remote-dir(pid=8747): Launched 19:52:33.399809 bus /sierra_2: Setting Powered False 19:52:34.469323 run rm-remote-dir(pid=8747): Terminated: ok {rc=0} 19:52:34.947962 run mk-remote-dir(pid=8748): Launched 19:52:36.138630 run mk-remote-dir(pid=8748): Terminated: ok {rc=0} 19:52:36.431045 run scp-inst-to-remote(pid=8749): Launched 19:52:38.617043 run scp-inst-to-remote(pid=8749): Terminated: ok {rc=0} 19:52:38.981236 run rm-remote-dir(pid=8751): Launched 19:52:40.174764 run rm-remote-dir(pid=8751): Terminated: ok {rc=0} 19:52:40.540319 run mk-remote-dir(pid=8752): Launched 19:52:41.734546 run mk-remote-dir(pid=8752): Terminated: ok {rc=0} 19:52:42.045763 run scp-cfg-to-remote(pid=8753): Launched 19:52:43.235597 run scp-cfg-to-remote(pid=8753): Terminated: ok {rc=0} 19:52:43.543750 run scp-db-to-remote(pid=8755): Launched 19:52:44.735237 run scp-db-to-remote(pid=8755): Terminated: ok {rc=0} 19:52:44.878189 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:52:45.214447 run patchelf(pid=8757): Launched 19:52:46.429080 run patchelf(pid=8757): Terminated: ok {rc=0} 19:52:46.618190 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:52:46.988545 run setcap-netadm(pid=8758): Launched 19:52:48.225558 run setcap-netadm(pid=8758): Terminated: ok {rc=0} 19:52:48.554677 run srsepc(pid=8759): Launched 19:52:48.672508 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:52:49.795585 run rm-remote-dir(pid=8760): Launched 19:52:49.975764 run srsepc(pid=8759): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8759)] 19:52:50.113566 run srsepc(pid=8759): stdout: | (launched: 2022-12-09_19:52:48.496726) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:52:50.250858 run srsepc(pid=8759): stderr: | (launched: 2022-12-09_19:52:48.543185) | Connection to 10.42.42.116 closed. 19:52:50.387902 run srsepc(pid=8759): stdout: | (launched: 2022-12-09_19:52:48.496726) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:52:50.519273 run srsepc(pid=8759): stderr: | (launched: 2022-12-09_19:52:48.543185) | Connection to 10.42.42.116 closed. 19:52:50.675133 run rm-remote-dir(pid=8760): Terminating (SIGINT) 19:52:50.856050 run rm-remote-dir(pid=8760): Terminated: ok {rc=0} 19:52:50.986908 tst handover.py:37: ERR: Error: srsepc(pid=8759): Process ended prematurely: srsepc(pid=8759) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8759)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 19:52:50.996843 tst handover.py:37: Test FAILED (20.2 sec) 19:52:51.075526 run scp-back-log(pid=8761): Launched 19:52:52.153218 run scp-back-log(pid=8761): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8761)] 19:52:52.213446 run scp-back-log(pid=8761): stdout: | (launched: 2022-12-09_19:52:51.043034) 19:52:52.275378 run scp-back-log(pid=8761): stderr: | (launched: 2022-12-09_19:52:51.062729) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:52:52.344715 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8761): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8761)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 19:52:52.389485 tst iperf3_bidir.py:13: Number of physical ue: 1 19:52:52.598385 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:52:52.640483 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 19:52:52.848341 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:52:52.864017 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:52:52.895507 tst iperf3_bidir.py: using MSISDN 7356 19:52:53.007848 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7356', subscriber_id=0} 19:52:53.117130 run srsepc_10.42.42.118: Starting srsepc 19:52:53.754875 run rm-remote-dir(pid=8763): Launched 19:52:54.937500 run rm-remote-dir(pid=8763): Terminated: ok {rc=0} 19:52:55.279459 run mk-remote-dir(pid=8764): Launched 19:52:56.460889 run mk-remote-dir(pid=8764): Terminated: ok {rc=0} 19:52:56.751070 run scp-inst-to-remote(pid=8765): Launched 19:52:58.933988 run scp-inst-to-remote(pid=8765): Terminated: ok {rc=0} 19:52:59.274151 run rm-remote-dir(pid=8767): Launched 19:53:00.456223 run rm-remote-dir(pid=8767): Terminated: ok {rc=0} 19:53:00.798131 run mk-remote-dir(pid=8768): Launched 19:53:02.030100 run mk-remote-dir(pid=8768): Terminated: ok {rc=0} 19:53:02.437195 run scp-cfg-to-remote(pid=8784): Launched 19:53:03.771609 run scp-cfg-to-remote(pid=8784): Terminated: ok {rc=0} 19:53:04.114081 run scp-db-to-remote(pid=9040): Launched 19:53:05.360530 run scp-db-to-remote(pid=9040): Terminated: ok {rc=0} 19:53:05.497576 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:53:05.825755 run patchelf(pid=9044): Launched 19:53:07.037372 run patchelf(pid=9044): Terminated: ok {rc=0} 19:53:07.185803 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:53:07.533459 run setcap-netadm(pid=9046): Launched 19:53:08.789554 run setcap-netadm(pid=9046): Terminated: ok {rc=0} 19:53:09.156709 run srsepc(pid=9047): Launched 19:53:09.319293 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:53:10.576675 run rm-remote-dir(pid=9048): Launched 19:53:10.890004 run srsepc(pid=9047): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9047)] 19:53:11.041981 run srsepc(pid=9047): stdout: | (launched: 2022-12-09_19:53:09.093444) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:11.194332 run srsepc(pid=9047): stderr: | (launched: 2022-12-09_19:53:09.145959) | Connection to 10.42.42.116 closed. 19:53:11.347839 run srsepc(pid=9047): stdout: | (launched: 2022-12-09_19:53:09.093444) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:11.492713 run srsepc(pid=9047): stderr: | (launched: 2022-12-09_19:53:09.145959) | Connection to 10.42.42.116 closed. 19:53:11.665595 run rm-remote-dir(pid=9048): Terminating (SIGINT) 19:53:11.866695 run rm-remote-dir(pid=9048): Terminated: ok {rc=0} 19:53:12.013277 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=9047): Process ended prematurely: srsepc(pid=9047) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9047)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 19:53:12.025550 tst iperf3_bidir.py:42: Test FAILED (19.6 sec) 19:53:12.111590 run scp-back-log(pid=9049): Launched 19:53:13.198173 run scp-back-log(pid=9049): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9049)] 19:53:13.265768 run scp-back-log(pid=9049): stdout: | (launched: 2022-12-09_19:53:12.078559) 19:53:13.334204 run scp-back-log(pid=9049): stderr: | (launched: 2022-12-09_19:53:12.099411) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:53:13.412130 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9049): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9049)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 19:53:13.462893 tst iperf3_dl.py:13: Number of physical ue: 1 19:53:13.699641 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:53:13.749815 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 19:53:13.983291 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:53:14.000717 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:53:14.035072 tst iperf3_dl.py: using MSISDN 7357 19:53:14.162159 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7357', subscriber_id=0} 19:53:14.283987 run srsepc_10.42.42.118: Starting srsepc 19:53:14.990159 run rm-remote-dir(pid=9051): Launched 19:53:16.290256 run rm-remote-dir(pid=9051): Terminated: ok {rc=0} 19:53:16.661972 run mk-remote-dir(pid=9052): Launched 19:53:17.943243 run mk-remote-dir(pid=9052): Terminated: ok {rc=0} 19:53:18.266797 run scp-inst-to-remote(pid=9053): Launched 19:53:20.513529 run scp-inst-to-remote(pid=9053): Terminated: ok {rc=0} 19:53:20.867786 run rm-remote-dir(pid=9055): Launched 19:53:22.109537 run rm-remote-dir(pid=9055): Terminated: ok {rc=0} 19:53:22.467357 run mk-remote-dir(pid=9056): Launched 19:53:23.720060 run mk-remote-dir(pid=9056): Terminated: ok {rc=0} 19:53:24.031862 run scp-cfg-to-remote(pid=9057): Launched 19:53:25.223652 run scp-cfg-to-remote(pid=9057): Terminated: ok {rc=0} 19:53:25.533223 run scp-db-to-remote(pid=9059): Launched 19:53:26.725495 run scp-db-to-remote(pid=9059): Terminated: ok {rc=0} 19:53:26.868170 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:53:27.204893 run patchelf(pid=9061): Launched 19:53:28.396499 run patchelf(pid=9061): Terminated: ok {rc=0} 19:53:28.539131 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:53:28.875687 run setcap-netadm(pid=9062): Launched 19:53:30.068195 run setcap-netadm(pid=9062): Terminated: ok {rc=0} 19:53:30.422638 run srsepc(pid=9063): Launched 19:53:30.546896 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:53:31.823629 run rm-remote-dir(pid=9064): Launched 19:53:32.154467 run srsepc(pid=9063): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9063)] 19:53:32.297178 run srsepc(pid=9063): stdout: | (launched: 2022-12-09_19:53:30.359443) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:32.434447 run srsepc(pid=9063): stderr: | (launched: 2022-12-09_19:53:30.409442) | Connection to 10.42.42.116 closed. 19:53:32.571433 run srsepc(pid=9063): stdout: | (launched: 2022-12-09_19:53:30.359443) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:32.703077 run srsepc(pid=9063): stderr: | (launched: 2022-12-09_19:53:30.409442) | Connection to 10.42.42.116 closed. 19:53:32.858495 run rm-remote-dir(pid=9064): Terminating (SIGINT) 19:53:33.038821 run rm-remote-dir(pid=9064): Terminated: ok {rc=0} 19:53:33.169258 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=9063): Process ended prematurely: srsepc(pid=9063) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9063)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 19:53:33.179237 tst iperf3_dl.py:42: Test FAILED (19.7 sec) 19:53:33.256464 run scp-back-log(pid=9065): Launched 19:53:34.332513 run scp-back-log(pid=9065): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9065)] 19:53:34.392265 run scp-back-log(pid=9065): stdout: | (launched: 2022-12-09_19:53:33.225385) 19:53:34.453233 run scp-back-log(pid=9065): stderr: | (launched: 2022-12-09_19:53:33.244867) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:53:34.522382 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9065): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9065)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 19:53:34.566799 tst iperf3_ul.py:13: Number of physical ue: 1 19:53:34.777074 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:53:34.819244 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 19:53:35.028132 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:53:35.043739 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:53:35.074876 tst iperf3_ul.py: using MSISDN 7358 19:53:35.187437 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7358', subscriber_id=0} 19:53:35.296781 run srsepc_10.42.42.118: Starting srsepc 19:53:35.938596 run rm-remote-dir(pid=9067): Launched 19:53:37.121674 run rm-remote-dir(pid=9067): Terminated: ok {rc=0} 19:53:37.465118 run mk-remote-dir(pid=9068): Launched 19:53:38.648069 run mk-remote-dir(pid=9068): Terminated: ok {rc=0} 19:53:38.940676 run scp-inst-to-remote(pid=9069): Launched 19:53:41.123731 run scp-inst-to-remote(pid=9069): Terminated: ok {rc=0} 19:53:41.465649 run rm-remote-dir(pid=9071): Launched 19:53:42.650588 run rm-remote-dir(pid=9071): Terminated: ok {rc=0} 19:53:42.994739 run mk-remote-dir(pid=9072): Launched 19:53:44.177807 run mk-remote-dir(pid=9072): Terminated: ok {rc=0} 19:53:44.470442 run scp-cfg-to-remote(pid=9073): Launched 19:53:45.651787 run scp-cfg-to-remote(pid=9073): Terminated: ok {rc=0} 19:53:45.975555 run scp-db-to-remote(pid=9075): Launched 19:53:47.219045 run scp-db-to-remote(pid=9075): Terminated: ok {rc=0} 19:53:47.354427 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:53:47.671194 run patchelf(pid=9077): Launched 19:53:48.852736 run patchelf(pid=9077): Terminated: ok {rc=0} 19:53:48.987334 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:53:49.303614 run setcap-netadm(pid=9078): Launched 19:53:50.484927 run setcap-netadm(pid=9078): Terminated: ok {rc=0} 19:53:50.818467 run srsepc(pid=9079): Launched 19:53:50.935865 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:53:52.065212 run rm-remote-dir(pid=9080): Launched 19:53:52.245966 run srsepc(pid=9079): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9079)] 19:53:52.384391 run srsepc(pid=9079): stdout: | (launched: 2022-12-09_19:53:50.760410) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:52.522148 run srsepc(pid=9079): stderr: | (launched: 2022-12-09_19:53:50.806972) | Connection to 10.42.42.116 closed. 19:53:52.659684 run srsepc(pid=9079): stdout: | (launched: 2022-12-09_19:53:50.760410) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:53:52.791239 run srsepc(pid=9079): stderr: | (launched: 2022-12-09_19:53:50.806972) | Connection to 10.42.42.116 closed. 19:53:52.947432 run rm-remote-dir(pid=9080): Terminating (SIGINT) 19:53:53.128137 run rm-remote-dir(pid=9080): Terminated: ok {rc=0} 19:53:53.259253 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=9079): Process ended prematurely: srsepc(pid=9079) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9079)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 19:53:53.269415 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 19:53:53.346605 run scp-back-log(pid=9081): Launched 19:53:54.425207 run scp-back-log(pid=9081): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9081)] 19:53:54.485603 run scp-back-log(pid=9081): stdout: | (launched: 2022-12-09_19:53:53.315420) 19:53:54.547461 run scp-back-log(pid=9081): stderr: | (launched: 2022-12-09_19:53:53.334960) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:53:54.617103 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9081): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9081)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 19:53:54.662626 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:53:54.679485 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:53:54.702014 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:53:54.749289 tst ping.py: using MSISDN 7359 19:53:54.864149 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7359', subscriber_id=0} 19:53:54.973597 run srsepc_10.42.42.118: Starting srsepc 19:53:55.615764 run rm-remote-dir(pid=9083): Launched 19:53:56.798649 run rm-remote-dir(pid=9083): Terminated: ok {rc=0} 19:53:57.141547 run mk-remote-dir(pid=9084): Launched 19:53:58.323472 run mk-remote-dir(pid=9084): Terminated: ok {rc=0} 19:53:58.614985 run scp-inst-to-remote(pid=9085): Launched 19:54:00.799817 run scp-inst-to-remote(pid=9085): Terminated: ok {rc=0} 19:54:01.189714 run rm-remote-dir(pid=9087): Launched 19:54:02.436756 run rm-remote-dir(pid=9087): Terminated: ok {rc=0} 19:54:02.779197 run mk-remote-dir(pid=9088): Launched 19:54:03.961194 run mk-remote-dir(pid=9088): Terminated: ok {rc=0} 19:54:04.253085 run scp-cfg-to-remote(pid=9089): Launched 19:54:05.433622 run scp-cfg-to-remote(pid=9089): Terminated: ok {rc=0} 19:54:05.723614 run scp-db-to-remote(pid=9091): Launched 19:54:06.903706 run scp-db-to-remote(pid=9091): Terminated: ok {rc=0} 19:54:07.037314 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:07.350742 run patchelf(pid=9093): Launched 19:54:08.531333 run patchelf(pid=9093): Terminated: ok {rc=0} 19:54:08.664675 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:54:08.978339 run setcap-netadm(pid=9094): Launched 19:54:10.158612 run setcap-netadm(pid=9094): Terminated: ok {rc=0} 19:54:10.486887 run srsepc(pid=9095): Launched 19:54:10.603810 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:11.732092 run rm-remote-dir(pid=9096): Launched 19:54:11.913118 run srsepc(pid=9095): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9095)] 19:54:12.051814 run srsepc(pid=9095): stdout: | (launched: 2022-12-09_19:54:10.429350) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:12.189539 run srsepc(pid=9095): stderr: | (launched: 2022-12-09_19:54:10.475319) | Connection to 10.42.42.116 closed. 19:54:12.327213 run srsepc(pid=9095): stdout: | (launched: 2022-12-09_19:54:10.429350) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:12.458401 run srsepc(pid=9095): stderr: | (launched: 2022-12-09_19:54:10.475319) | Connection to 10.42.42.116 closed. 19:54:12.614013 run rm-remote-dir(pid=9096): Terminating (SIGINT) 19:54:12.795256 run rm-remote-dir(pid=9096): Terminated: ok {rc=0} 19:54:12.925976 tst ping.py:16: ERR: Error: srsepc(pid=9095): Process ended prematurely: srsepc(pid=9095) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9095)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 19:54:12.935932 tst ping.py:16: Test FAILED (18.3 sec) 19:54:13.012723 run scp-back-log(pid=9097): Launched 19:54:14.089398 run scp-back-log(pid=9097): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9097)] 19:54:14.149183 run scp-back-log(pid=9097): stdout: | (launched: 2022-12-09_19:54:12.981893) 19:54:14.210557 run scp-back-log(pid=9097): stderr: | (launched: 2022-12-09_19:54:13.001387) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:14.279436 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9097): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9097)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 19:54:14.324320 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:54:14.340861 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:54:14.363603 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:54:14.416695 tst rrc_idle_mo_ping.py: using MSISDN 7360 19:54:14.532591 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7360', subscriber_id=0} 19:54:14.641849 run srsepc_10.42.42.118: Starting srsepc 19:54:15.281632 run rm-remote-dir(pid=9100): Launched 19:54:16.471808 run rm-remote-dir(pid=9100): Terminated: ok {rc=0} 19:54:16.823086 run mk-remote-dir(pid=9101): Launched 19:54:18.070683 run mk-remote-dir(pid=9101): Terminated: ok {rc=0} 19:54:18.363342 run scp-inst-to-remote(pid=9102): Launched 19:54:20.549304 run scp-inst-to-remote(pid=9102): Terminated: ok {rc=0} 19:54:20.914008 run rm-remote-dir(pid=9104): Launched 19:54:22.108029 run rm-remote-dir(pid=9104): Terminated: ok {rc=0} 19:54:22.474795 run mk-remote-dir(pid=9105): Launched 19:54:23.670623 run mk-remote-dir(pid=9105): Terminated: ok {rc=0} 19:54:23.983142 run scp-cfg-to-remote(pid=9106): Launched 19:54:25.175312 run scp-cfg-to-remote(pid=9106): Terminated: ok {rc=0} 19:54:25.485094 run scp-db-to-remote(pid=9108): Launched 19:54:26.677716 run scp-db-to-remote(pid=9108): Terminated: ok {rc=0} 19:54:26.821227 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:27.158333 run patchelf(pid=9110): Launched 19:54:28.348343 run patchelf(pid=9110): Terminated: ok {rc=0} 19:54:28.490905 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:54:28.827412 run setcap-netadm(pid=9111): Launched 19:54:30.018263 run setcap-netadm(pid=9111): Terminated: ok {rc=0} 19:54:30.370071 run srsepc(pid=9112): Launched 19:54:30.494455 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:31.747572 run rm-remote-dir(pid=9113): Launched 19:54:32.106941 run srsepc(pid=9112): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9112)] 19:54:32.259505 run srsepc(pid=9112): stdout: | (launched: 2022-12-09_19:54:30.308534) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:32.406285 run srsepc(pid=9112): stderr: | (launched: 2022-12-09_19:54:30.358411) | Connection to 10.42.42.116 closed. 19:54:32.552705 run srsepc(pid=9112): stdout: | (launched: 2022-12-09_19:54:30.308534) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:32.693129 run srsepc(pid=9112): stderr: | (launched: 2022-12-09_19:54:30.358411) | Connection to 10.42.42.116 closed. 19:54:32.859830 run rm-remote-dir(pid=9113): Terminating (SIGINT) 19:54:33.053326 run rm-remote-dir(pid=9113): Terminated: ok {rc=0} 19:54:33.193119 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=9112): Process ended prematurely: srsepc(pid=9112) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9112)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 19:54:33.203919 tst rrc_idle_mo_ping.py:16: Test FAILED (18.9 sec) 19:54:33.286343 run scp-back-log(pid=9114): Launched 19:54:34.366452 run scp-back-log(pid=9114): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9114)] 19:54:34.430310 run scp-back-log(pid=9114): stdout: | (launched: 2022-12-09_19:54:33.253434) 19:54:34.495603 run scp-back-log(pid=9114): stderr: | (launched: 2022-12-09_19:54:33.274288) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:34.569063 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9114): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9114)]') ---------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 19:54:34.616892 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:54:34.634286 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:54:34.658191 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:54:34.708518 tst rrc_idle_mt_ping.py: using MSISDN 7361 19:54:34.833140 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7361', subscriber_id=0} 19:54:34.951165 run srsepc_10.42.42.118: Starting srsepc 19:54:35.636004 run rm-remote-dir(pid=9116): Launched 19:54:36.831422 run rm-remote-dir(pid=9116): Terminated: ok {rc=0} 19:54:37.199211 run mk-remote-dir(pid=9117): Launched 19:54:38.393182 run mk-remote-dir(pid=9117): Terminated: ok {rc=0} 19:54:38.704458 run scp-inst-to-remote(pid=9118): Launched 19:54:40.898549 run scp-inst-to-remote(pid=9118): Terminated: ok {rc=0} 19:54:41.263955 run rm-remote-dir(pid=9120): Launched 19:54:42.457026 run rm-remote-dir(pid=9120): Terminated: ok {rc=0} 19:54:42.823553 run mk-remote-dir(pid=9121): Launched 19:54:44.019722 run mk-remote-dir(pid=9121): Terminated: ok {rc=0} 19:54:44.331241 run scp-cfg-to-remote(pid=9122): Launched 19:54:45.522242 run scp-cfg-to-remote(pid=9122): Terminated: ok {rc=0} 19:54:45.832765 run scp-db-to-remote(pid=9124): Launched 19:54:47.115341 run scp-db-to-remote(pid=9124): Terminated: ok {rc=0} 19:54:47.277772 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:47.619287 run patchelf(pid=9126): Launched 19:54:48.812066 run patchelf(pid=9126): Terminated: ok {rc=0} 19:54:48.954941 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:54:49.292142 run setcap-netadm(pid=9127): Launched 19:54:50.484175 run setcap-netadm(pid=9127): Terminated: ok {rc=0} 19:54:50.837077 run srsepc(pid=9128): Launched 19:54:50.961380 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:52.160790 run rm-remote-dir(pid=9129): Launched 19:54:52.351422 run srsepc(pid=9128): ERR: Terminated: ERROR {rc=127} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9128)] 19:54:52.497699 run srsepc(pid=9128): stdout: | (launched: 2022-12-09_19:54:50.775202) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:52.644521 run srsepc(pid=9128): stderr: | (launched: 2022-12-09_19:54:50.824779) | Connection to 10.42.42.116 closed. 19:54:52.790945 run srsepc(pid=9128): stdout: | (launched: 2022-12-09_19:54:50.775202) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:52.939353 run srsepc(pid=9128): stderr: | (launched: 2022-12-09_19:54:50.824779) | Connection to 10.42.42.116 closed. 19:54:53.103453 run rm-remote-dir(pid=9129): Terminating (SIGINT) 19:54:53.293587 run rm-remote-dir(pid=9129): Terminated: ok {rc=0} 19:54:53.431307 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=9128): Process ended prematurely: srsepc(pid=9128) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9128)] [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 19:54:53.442165 tst rrc_idle_mt_ping.py:16: Test FAILED (18.8 sec) 19:54:53.523437 run scp-back-log(pid=9130): Launched 19:54:54.603364 run scp-back-log(pid=9130): ERR: Terminated: ERROR {rc=1} [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9130)] 19:54:54.667273 run scp-back-log(pid=9130): stdout: | (launched: 2022-12-09_19:54:53.491090) 19:54:54.732414 run scp-back-log(pid=9130): stderr: | (launched: 2022-12-09_19:54:53.511600) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:54.805985 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9130): launch_sync(): local process exited with status 1 [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9130)]') --------------------------------------------------------------------- trial-2363 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 19:54:54.938765 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:54.944897 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 19:54:54.985605 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 19:54:55.011742 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 19:54:55.063249 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 19:54:55.105204 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 19:54:55.131218 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 19:54:55.683979 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 19:54:55.689893 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:55.701022 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 19:54:55.740030 tst handover.py: using LAC 23336 19:54:55.876013 tst handover.py: using RAC 131 19:54:56.014200 tst handover.py: using CellId 23336 19:54:56.143382 tst handover.py: using BVCI 23337 19:54:56.262660 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 19:54:56.298347 tst handover.py: using LAC 23337 19:54:56.426926 tst handover.py: using RAC 132 19:54:56.554955 tst handover.py: using CellId 23337 19:54:56.683930 tst handover.py: using BVCI 23338 19:54:56.801891 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:56.813260 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:56.824205 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:56.835454 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:56.846846 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:54:56.858115 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 19:54:56.977340 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 19:54:57.096816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:57.599505 run create_hlr_db(pid=9135): Launched 19:54:58.788067 run create_hlr_db(pid=9135): Terminated: ok {rc=0} 19:54:59.130076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9137): Launched 19:54:59.454165 run osmo-hlr_10.42.42.2(pid=9138): Launched 19:54:59.578104 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:00.134241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9140): Launched 19:55:00.457644 run osmo-stp_10.42.42.5(pid=9141): Launched 19:55:00.580557 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:01.195258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9143): Launched 19:55:01.522522 run osmo-msc_10.42.42.6(pid=9144): Launched 19:55:01.703929 run osmo-stp_10.42.42.5(pid=9141): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9141)] 19:55:01.979384 run osmo-stp_10.42.42.5(pid=9141): stdout: | (launched: 2022-12-09_19:55:00.398248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:02.254255 run osmo-stp_10.42.42.5(pid=9141): stderr: | [0;m[38;5;43m20221209195500588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195500589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195500589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195500589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:02.411533 run osmo-stp_10.42.42.5(pid=9141): stdout: | (launched: 2022-12-09_19:55:00.398248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:02.540771 run osmo-stp_10.42.42.5(pid=9141): stderr: | [0;m[38;5;43m20221209195500588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195500589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195500589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195500589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195500590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:02.695718 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9141): Process ended prematurely: osmo-stp_10.42.42.5(pid=9141) [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9141)] [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 19:55:02.704859 tst handover.py:18: Test FAILED (7.0 sec) 19:55:02.732652 run osmo-hlr_10.42.42.2(pid=9138): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9138)] 19:55:02.782149 run osmo-hlr_10.42.42.2(pid=9138): stdout: | (launched: 2022-12-09_19:54:59.394729) 19:55:02.833297 run osmo-hlr_10.42.42.2(pid=9138): stderr: | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195459593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195459605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195459613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195459614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195459614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:02.904456 run osmo-msc_10.42.42.6(pid=9144): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9144)] 19:55:02.954236 run osmo-msc_10.42.42.6(pid=9144): stdout: | (launched: 2022-12-09_19:55:01.454924) 19:55:03.005358 run osmo-msc_10.42.42.6(pid=9144): stderr: | [0;m[38;5;43m20221209195502072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195502072 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4e68acdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195502072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195502072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195502072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195502081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195502083 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195502083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195502083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195502083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:03.056264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9137): Terminating (SIGTERM) 19:55:03.097644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9140): Terminating (SIGTERM) 19:55:03.139073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9143): Terminating (SIGTERM) 19:55:03.180927 --- ParallelTerminationStrategy: PID 9137 died... 19:55:03.200545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9137): Terminated: ok {rc=0} 19:55:03.246658 --- ParallelTerminationStrategy: PID 9140 died... 19:55:03.265956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9140): Terminated: ok {rc=0} 19:55:03.311709 --- ParallelTerminationStrategy: PID 9143 died... 19:55:03.331036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9143): Terminated: ok {rc=0} 19:55:03.417176 bus /sierra_3: Setting Powered False 19:55:04.514373 bus /sierra_3: Setting Powered False 19:55:05.628436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 19:55:06.873892 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:06.879869 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 19:55:06.918755 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 19:55:06.944892 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 19:55:06.996133 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 19:55:07.036900 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 19:55:07.064188 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 19:55:07.617966 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 19:55:07.623591 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:07.634922 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 19:55:07.674944 tst handover.py: using LAC 23338 19:55:07.803364 tst handover.py: using RAC 133 19:55:07.930335 tst handover.py: using CellId 23338 19:55:08.058870 tst handover.py: using BVCI 23339 19:55:08.176390 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 19:55:08.216385 tst handover.py: using LAC 23339 19:55:08.335633 tst handover.py: using RAC 134 19:55:08.453101 tst handover.py: using CellId 23339 19:55:08.570856 tst handover.py: using BVCI 23340 19:55:08.682397 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:08.693091 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:08.703645 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:08.714818 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:08.725962 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:55:08.736826 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 19:55:08.853864 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 19:55:08.972482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:09.447642 run create_hlr_db(pid=9153): Launched 19:55:09.571649 bus /sierra_2: Setting Powered False 19:55:10.632625 run create_hlr_db(pid=9153): Terminated: ok {rc=0} 19:55:11.029937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9155): Launched 19:55:11.334718 run osmo-hlr_10.42.42.2(pid=9156): Launched 19:55:11.450062 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:11.946333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9158): Launched 19:55:12.249557 run osmo-stp_10.42.42.5(pid=9159): Launched 19:55:12.365406 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:12.888029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9161): Launched 19:55:13.191683 run osmo-msc_10.42.42.6(pid=9162): Launched 19:55:13.361769 run osmo-stp_10.42.42.5(pid=9159): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9159)] 19:55:13.489197 run osmo-stp_10.42.42.5(pid=9159): stdout: | (launched: 2022-12-09_19:55:12.192699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:13.616772 run osmo-stp_10.42.42.5(pid=9159): stderr: | [0;m[38;5;43m20221209195512362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195512362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195512363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195512363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195512363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195512364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195512364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:13.742776 run osmo-stp_10.42.42.5(pid=9159): stdout: | (launched: 2022-12-09_19:55:12.192699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:13.863999 run osmo-stp_10.42.42.5(pid=9159): stderr: | [0;m[38;5;43m20221209195512362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195512362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195512363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195512363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195512363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195512364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195512364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:14.008126 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9159): Process ended prematurely: osmo-stp_10.42.42.5(pid=9159) [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9159)] [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 19:55:14.016632 tst handover.py:18: Test FAILED (6.4 sec) 19:55:14.042525 run osmo-hlr_10.42.42.2(pid=9156): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9156)] 19:55:14.089193 run osmo-hlr_10.42.42.2(pid=9156): stdout: | (launched: 2022-12-09_19:55:11.278553) 19:55:14.137114 run osmo-hlr_10.42.42.2(pid=9156): stderr: | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195511455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195511467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195511476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195511477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195511477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:14.204135 run osmo-msc_10.42.42.6(pid=9162): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9162)] 19:55:14.250951 run osmo-msc_10.42.42.6(pid=9162): stdout: | (launched: 2022-12-09_19:55:13.135385) 19:55:14.299211 run osmo-msc_10.42.42.6(pid=9162): stderr: | [0;m[38;5;43m20221209195513404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195513404 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4c127a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195513404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195513404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195513404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195513405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195513406 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195513407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195513407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195513407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:14.347534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9155): Terminating (SIGTERM) 19:55:14.386139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9158): Terminating (SIGTERM) 19:55:14.424851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9161): Terminating (SIGTERM) 19:55:14.463809 --- ParallelTerminationStrategy: PID 9155 died... 19:55:14.482408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9155): Terminated: ok {rc=0} 19:55:14.525228 --- ParallelTerminationStrategy: PID 9158 died... 19:55:14.543263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9158): Terminated: ok {rc=0} 19:55:14.585950 --- ParallelTerminationStrategy: PID 9161 died... 19:55:14.604223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9161): Terminated: ok {rc=0} 19:55:14.685150 bus /sierra_3: Setting Powered False 19:55:15.780855 bus /sierra_3: Setting Powered False 19:55:16.919950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 19:55:18.177448 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:18.183166 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:55:18.238926 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:55:18.265474 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:55:18.316142 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:55:18.368467 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:55:18.394277 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:55:18.944787 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 19:55:18.949952 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:18.960430 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:55:18.997039 tst handover.py: using LAC 23340 19:55:19.116441 tst handover.py: using RAC 135 19:55:19.246409 tst handover.py: using CellId 23340 19:55:19.373352 tst handover.py: using BVCI 23341 19:55:19.493029 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:55:19.542658 tst handover.py: using LAC 23341 19:55:19.669353 tst handover.py: using RAC 136 19:55:19.799590 tst handover.py: using CellId 23341 19:55:19.926783 tst handover.py: using BVCI 23342 19:55:20.045294 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:20.056446 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:20.067459 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:20.078849 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:20.090342 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:55:20.101730 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:55:20.219006 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:55:20.334326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:20.779439 run create_hlr_db(pid=9167): Launched 19:55:20.903049 bus /sierra_2: Setting Powered False 19:55:21.963196 run create_hlr_db(pid=9167): Terminated: ok {rc=0} 19:55:22.379402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9169): Launched 19:55:22.704500 run osmo-hlr_10.42.42.2(pid=9170): Launched 19:55:22.829170 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:23.362042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9172): Launched 19:55:23.692741 run osmo-stp_10.42.42.5(pid=9173): Launched 19:55:23.814596 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:24.366707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9175): Launched 19:55:24.687048 run osmo-msc_10.42.42.6(pid=9176): Launched 19:55:24.865258 run osmo-stp_10.42.42.5(pid=9173): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9173)] 19:55:25.001294 run osmo-stp_10.42.42.5(pid=9173): stdout: | (launched: 2022-12-09_19:55:23.634647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:25.136858 run osmo-stp_10.42.42.5(pid=9173): stderr: | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195523822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:25.270782 run osmo-stp_10.42.42.5(pid=9173): stdout: | (launched: 2022-12-09_19:55:23.634647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:25.398647 run osmo-stp_10.42.42.5(pid=9173): stderr: | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195523821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195523822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195523822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:25.551397 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9173): Process ended prematurely: osmo-stp_10.42.42.5(pid=9173) [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9173)] [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 19:55:25.560469 tst handover.py:18: Test FAILED (6.6 sec) 19:55:25.587980 run osmo-hlr_10.42.42.2(pid=9170): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9170)] 19:55:25.637157 run osmo-hlr_10.42.42.2(pid=9170): stdout: | (launched: 2022-12-09_19:55:22.644765) 19:55:25.687954 run osmo-hlr_10.42.42.2(pid=9170): stderr: | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195522846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195522858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195522866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195522866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195522866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:25.758683 run osmo-msc_10.42.42.6(pid=9176): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9176)] 19:55:25.807581 run osmo-msc_10.42.42.6(pid=9176): stdout: | (launched: 2022-12-09_19:55:24.628548) 19:55:25.858059 run osmo-msc_10.42.42.6(pid=9176): stderr: | [0;m[38;5;43m20221209195524944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195524944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc65415bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195524944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195524944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195524944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195524945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195524946 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195524947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195524947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195524947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:25.908915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9169): Terminating (SIGTERM) 19:55:25.950366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9172): Terminating (SIGTERM) 19:55:25.991512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9175): Terminating (SIGTERM) 19:55:26.032794 --- ParallelTerminationStrategy: PID 9169 died... 19:55:26.052375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9169): Terminated: ok {rc=0} 19:55:26.098384 --- ParallelTerminationStrategy: PID 9172 died... 19:55:26.117443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9172): Terminated: ok {rc=0} 19:55:26.162745 --- ParallelTerminationStrategy: PID 9175 died... 19:55:26.181805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9175): Terminated: ok {rc=0} 19:55:26.267004 bus /sierra_3: Setting Powered False 19:55:27.363970 bus /sierra_3: Setting Powered False 19:55:28.478428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:55:29.739954 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:29.745505 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:55:29.796308 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:55:29.823357 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:55:29.875056 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:55:29.924908 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:55:29.952147 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:55:30.504312 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:55:30.509685 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:30.520882 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:55:30.559634 tst handover.py: using LAC 23342 19:55:30.678848 tst handover.py: using RAC 137 19:55:30.797628 tst handover.py: using CellId 23342 19:55:30.930484 tst handover.py: using BVCI 23343 19:55:31.065969 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:55:31.112750 tst handover.py: using LAC 23343 19:55:31.233694 tst handover.py: using RAC 138 19:55:31.361930 tst handover.py: using CellId 23343 19:55:31.513791 tst handover.py: using BVCI 23344 19:55:31.632151 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:31.643773 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:31.655554 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:31.667586 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:31.680752 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:55:31.692113 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:55:31.839672 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:55:31.993373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:32.467264 run create_hlr_db(pid=9183): Launched 19:55:32.588445 bus /sierra_2: Setting Powered False 19:55:33.647764 run create_hlr_db(pid=9183): Terminated: ok {rc=0} 19:55:34.059614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Launched 19:55:34.380208 run osmo-hlr_10.42.42.2(pid=9186): Launched 19:55:34.502147 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:35.024057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Launched 19:55:35.343107 run osmo-stp_10.42.42.5(pid=9189): Launched 19:55:35.464446 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:36.017174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Launched 19:55:36.337251 run osmo-msc_10.42.42.6(pid=9192): Launched 19:55:36.515170 run osmo-stp_10.42.42.5(pid=9189): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] 19:55:36.650992 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-09_19:55:35.285153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:36.786584 run osmo-stp_10.42.42.5(pid=9189): stderr: | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195535472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:36.919666 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-09_19:55:35.285153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:37.047825 run osmo-stp_10.42.42.5(pid=9189): stderr: | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195535472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195535472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195535473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:37.200183 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 19:55:37.209106 tst handover.py:18: Test FAILED (6.7 sec) 19:55:37.236076 run osmo-hlr_10.42.42.2(pid=9186): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9186)] 19:55:37.285339 run osmo-hlr_10.42.42.2(pid=9186): stdout: | (launched: 2022-12-09_19:55:34.321947) 19:55:37.336052 run osmo-hlr_10.42.42.2(pid=9186): stderr: | [0;m[1;31m20221209195534515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195534516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195534516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195534516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195534516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195534516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195534528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195534536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195534537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195534537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:37.406425 run osmo-msc_10.42.42.6(pid=9192): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9192)] 19:55:37.455204 run osmo-msc_10.42.42.6(pid=9192): stdout: | (launched: 2022-12-09_19:55:36.278896) 19:55:37.506011 run osmo-msc_10.42.42.6(pid=9192): stderr: | [0;m[38;5;43m20221209195536597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195536597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa215396c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195536597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195536597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195536597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195536597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195536599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195536600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195536600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:37.556617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminating (SIGTERM) 19:55:37.597573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminating (SIGTERM) 19:55:37.638447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminating (SIGTERM) 19:55:37.679451 --- ParallelTerminationStrategy: PID 9185 died... 19:55:37.698945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminated: ok {rc=0} 19:55:37.744358 --- ParallelTerminationStrategy: PID 9188 died... 19:55:37.763417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminated: ok {rc=0} 19:55:37.808590 --- ParallelTerminationStrategy: PID 9191 died... 19:55:37.827546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminated: ok {rc=0} 19:55:37.913162 bus /sierra_3: Setting Powered False 19:55:39.009884 bus /sierra_3: Setting Powered False 19:55:40.124487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:55:41.384914 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:41.390830 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:55:41.443084 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:55:41.468765 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:55:41.517737 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:55:41.570132 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:55:41.595618 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:55:42.148869 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:55:42.154285 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:42.165033 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:55:42.201590 tst handover.py: using LAC 23344 19:55:42.326653 tst handover.py: using RAC 139 19:55:42.449907 tst handover.py: using CellId 23344 19:55:42.575827 tst handover.py: using BVCI 23345 19:55:42.691946 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:55:42.740711 tst handover.py: using LAC 23345 19:55:42.864777 tst handover.py: using RAC 140 19:55:42.991634 tst handover.py: using CellId 23345 19:55:43.115361 tst handover.py: using BVCI 23346 19:55:43.231353 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:43.242644 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:43.253718 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:43.265068 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:43.276331 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:55:43.287798 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:55:43.405922 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:55:43.518943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:43.957477 run create_hlr_db(pid=9197): Launched 19:55:44.079624 bus /sierra_2: Setting Powered False 19:55:45.140002 run create_hlr_db(pid=9197): Terminated: ok {rc=0} 19:55:45.548707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Launched 19:55:45.899221 run osmo-hlr_10.42.42.2(pid=9200): Launched 19:55:46.130950 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:46.734028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Launched 19:55:47.074060 run osmo-stp_10.42.42.5(pid=9203): Launched 19:55:47.195663 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:47.725621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Launched 19:55:48.022529 run osmo-msc_10.42.42.6(pid=9206): Launched 19:55:48.187342 run osmo-stp_10.42.42.5(pid=9203): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] 19:55:48.313946 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-09_19:55:47.010288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:48.439512 run osmo-stp_10.42.42.5(pid=9203): stderr: | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195547313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195547313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195547313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195547314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:48.563845 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-09_19:55:47.010288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:48.683521 run osmo-stp_10.42.42.5(pid=9203): stderr: | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195547312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195547313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195547313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195547313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195547314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:48.825603 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 19:55:48.833744 tst handover.py:18: Test FAILED (6.7 sec) 19:55:48.858916 run osmo-hlr_10.42.42.2(pid=9200): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9200)] 19:55:48.905232 run osmo-hlr_10.42.42.2(pid=9200): stdout: | (launched: 2022-12-09_19:55:45.809952) 19:55:48.953082 run osmo-hlr_10.42.42.2(pid=9200): stderr: | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195546081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195546097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195546114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195546115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195546115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:49.019961 run osmo-msc_10.42.42.6(pid=9206): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9206)] 19:55:49.066101 run osmo-msc_10.42.42.6(pid=9206): stdout: | (launched: 2022-12-09_19:55:47.968133) 19:55:49.114021 run osmo-msc_10.42.42.6(pid=9206): stderr: | [0;m[38;5;43m20221209195548235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195548235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c7ee8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195548235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195548235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195548236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195548237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195548238 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195548239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195548239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195548239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:49.162224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminating (SIGTERM) 19:55:49.200773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminating (SIGTERM) 19:55:49.239397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminating (SIGTERM) 19:55:49.278740 --- ParallelTerminationStrategy: PID 9199 died... 19:55:49.297453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminated: ok {rc=0} 19:55:49.340554 --- ParallelTerminationStrategy: PID 9202 died... 19:55:49.359074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminated: ok {rc=0} 19:55:49.402314 --- ParallelTerminationStrategy: PID 9205 died... 19:55:49.420515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminated: ok {rc=0} 19:55:49.505302 bus /sierra_3: Setting Powered False 19:55:50.603806 bus /sierra_3: Setting Powered False 19:55:51.718569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 19:55:52.977523 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:52.982479 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:55:53.022700 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:55:53.048339 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:55:53.098841 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:55:53.139001 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:55:53.164545 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:55:53.715039 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 19:55:53.720075 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:53.730574 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:55:53.766931 tst handover.py: using LAC 23346 19:55:53.884144 tst handover.py: using RAC 141 19:55:54.001667 tst handover.py: using CellId 23346 19:55:54.117626 tst handover.py: using BVCI 23347 19:55:54.226738 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:55:54.261293 tst handover.py: using LAC 23347 19:55:54.380614 tst handover.py: using RAC 142 19:55:54.496658 tst handover.py: using CellId 23347 19:55:54.612445 tst handover.py: using BVCI 23348 19:55:54.719610 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:54.730275 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:54.740623 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:54.751050 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:54.761509 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:55:54.771863 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:55:54.888165 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:55:55.007790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:55.477353 run create_hlr_db(pid=9211): Launched 19:55:55.599856 bus /sierra_2: Setting Powered False 19:55:56.663592 run create_hlr_db(pid=9211): Terminated: ok {rc=0} 19:55:57.079942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Launched 19:55:57.398553 run osmo-hlr_10.42.42.2(pid=9214): Launched 19:55:57.521413 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:58.043590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9216): Launched 19:55:58.363908 run osmo-stp_10.42.42.5(pid=9217): Launched 19:55:58.485901 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:59.037472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9219): Launched 19:55:59.357945 run osmo-msc_10.42.42.6(pid=9220): Launched 19:55:59.543096 run osmo-stp_10.42.42.5(pid=9217): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9217)] 19:55:59.679054 run osmo-stp_10.42.42.5(pid=9217): stdout: | (launched: 2022-12-09_19:55:58.305079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:59.815126 run osmo-stp_10.42.42.5(pid=9217): stderr: | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195558492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:59.948358 run osmo-stp_10.42.42.5(pid=9217): stdout: | (launched: 2022-12-09_19:55:58.305079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:00.076415 run osmo-stp_10.42.42.5(pid=9217): stderr: | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195558491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195558492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195558492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:00.229353 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9217): Process ended prematurely: osmo-stp_10.42.42.5(pid=9217) [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9217)] [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 19:56:00.238312 tst handover.py:18: Test FAILED (6.5 sec) 19:56:00.265712 run osmo-hlr_10.42.42.2(pid=9214): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9214)] 19:56:00.315219 run osmo-hlr_10.42.42.2(pid=9214): stdout: | (launched: 2022-12-09_19:55:57.340700) 19:56:00.366052 run osmo-hlr_10.42.42.2(pid=9214): stderr: | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195557534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195557547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195557555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195557555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195557555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:00.436760 run osmo-msc_10.42.42.6(pid=9220): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9220)] 19:56:00.486011 run osmo-msc_10.42.42.6(pid=9220): stdout: | (launched: 2022-12-09_19:55:59.299308) 19:56:00.536811 run osmo-msc_10.42.42.6(pid=9220): stderr: | [0;m[38;5;43m20221209195559617 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195559618 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feca90bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195559618 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195559618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195559618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195559618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195559620 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195559620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195559620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195559620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:00.588129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Terminating (SIGTERM) 19:56:00.629514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9216): Terminating (SIGTERM) 19:56:00.670561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9219): Terminating (SIGTERM) 19:56:00.712240 --- ParallelTerminationStrategy: PID 9213 died... 19:56:00.731965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Terminated: ok {rc=0} 19:56:00.778410 --- ParallelTerminationStrategy: PID 9216 died... 19:56:00.797718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9216): Terminated: ok {rc=0} 19:56:00.844074 --- ParallelTerminationStrategy: PID 9219 died... 19:56:00.863831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9219): Terminated: ok {rc=0} 19:56:00.961450 bus /sierra_3: Setting Powered False 19:56:02.065140 bus /sierra_3: Setting Powered False 19:56:03.188064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 19:56:04.434465 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:04.440612 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:56:04.494855 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:56:04.520495 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:56:04.571407 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:56:04.623878 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:56:04.649590 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:56:05.201313 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 19:56:05.206392 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:05.217066 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:56:05.254410 tst handover.py: using LAC 23348 19:56:05.373311 tst handover.py: using RAC 143 19:56:05.490829 tst handover.py: using CellId 23348 19:56:05.609414 tst handover.py: using BVCI 23349 19:56:05.726627 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:56:05.775452 tst handover.py: using LAC 23349 19:56:05.905720 tst handover.py: using RAC 144 19:56:06.026133 tst handover.py: using CellId 23349 19:56:06.144212 tst handover.py: using BVCI 23350 19:56:06.252613 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:06.263233 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:06.273689 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:06.284676 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:06.295662 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:56:06.306641 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:56:06.424854 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:56:06.544193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:07.012771 run create_hlr_db(pid=9225): Launched 19:56:07.135362 bus /sierra_2: Setting Powered False 19:56:08.198541 run create_hlr_db(pid=9225): Terminated: ok {rc=0} 19:56:08.615635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Launched 19:56:08.935925 run osmo-hlr_10.42.42.2(pid=9228): Launched 19:56:09.058167 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:09.586091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Launched 19:56:09.904641 run osmo-stp_10.42.42.5(pid=9231): Launched 19:56:10.026579 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:10.575291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Launched 19:56:10.894016 run osmo-msc_10.42.42.6(pid=9234): Launched 19:56:11.071380 run osmo-stp_10.42.42.5(pid=9231): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] 19:56:11.208865 run osmo-stp_10.42.42.5(pid=9231): stdout: | (launched: 2022-12-09_19:56:09.846514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:11.343335 run osmo-stp_10.42.42.5(pid=9231): stderr: | [0;m[38;5;43m20221209195610034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195610034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195610035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195610035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195610035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195610035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195610036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:11.476785 run osmo-stp_10.42.42.5(pid=9231): stdout: | (launched: 2022-12-09_19:56:09.846514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:11.604138 run osmo-stp_10.42.42.5(pid=9231): stderr: | [0;m[38;5;43m20221209195610034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195610034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195610035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195610035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195610035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195610035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195610036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:11.756506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9231): Process ended prematurely: osmo-stp_10.42.42.5(pid=9231) [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 19:56:11.765529 tst handover.py:18: Test FAILED (6.6 sec) 19:56:11.792515 run osmo-hlr_10.42.42.2(pid=9228): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9228)] 19:56:11.842071 run osmo-hlr_10.42.42.2(pid=9228): stdout: | (launched: 2022-12-09_19:56:08.878089) 19:56:11.892906 run osmo-hlr_10.42.42.2(pid=9228): stderr: | [0;m[1;31m20221209195609074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195609074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195609075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195609075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195609075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195609075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195609087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195609095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195609095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195609095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:11.963547 run osmo-msc_10.42.42.6(pid=9234): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9234)] 19:56:12.013055 run osmo-msc_10.42.42.6(pid=9234): stdout: | (launched: 2022-12-09_19:56:10.836131) 19:56:12.063750 run osmo-msc_10.42.42.6(pid=9234): stderr: | [0;m[38;5;43m20221209195611153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195611154 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50f0805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195611154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195611154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195611154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195611154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195611157 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195611157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195611158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195611158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:12.114667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Terminating (SIGTERM) 19:56:12.155564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Terminating (SIGTERM) 19:56:12.196457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Terminating (SIGTERM) 19:56:12.238038 --- ParallelTerminationStrategy: PID 9227 died... 19:56:12.257563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Terminated: ok {rc=0} 19:56:12.303413 --- ParallelTerminationStrategy: PID 9230 died... 19:56:12.322520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Terminated: ok {rc=0} 19:56:12.368133 --- ParallelTerminationStrategy: PID 9233 died... 19:56:12.387171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Terminated: ok {rc=0} 19:56:12.473904 bus /sierra_3: Setting Powered False 19:56:13.569850 bus /sierra_3: Setting Powered False 19:56:14.683857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 19:56:15.958933 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:15.964687 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:56:16.021447 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:56:16.048537 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:56:16.100690 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:56:16.165099 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:56:16.193646 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:56:16.762471 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 19:56:16.771194 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:16.788439 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:56:16.840023 tst handover.py: using LAC 23350 19:56:16.961065 tst handover.py: using RAC 145 19:56:17.121117 tst handover.py: using CellId 23350 19:56:17.277073 tst handover.py: using BVCI 23351 19:56:17.396329 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:56:17.443927 tst handover.py: using LAC 23351 19:56:17.561294 tst handover.py: using RAC 146 19:56:17.686126 tst handover.py: using CellId 23351 19:56:17.809378 tst handover.py: using BVCI 23352 19:56:17.926554 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:17.937758 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:17.948653 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:17.960402 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:17.971526 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:56:17.983246 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:56:18.098236 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:56:18.215687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:18.683044 run create_hlr_db(pid=9239): Launched 19:56:18.804249 bus /sierra_2: Setting Powered False 19:56:19.867799 run create_hlr_db(pid=9239): Terminated: ok {rc=0} 19:56:20.283083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9241): Launched 19:56:20.602341 run osmo-hlr_10.42.42.2(pid=9242): Launched 19:56:20.724294 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:21.248942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9244): Launched 19:56:21.567581 run osmo-stp_10.42.42.5(pid=9245): Launched 19:56:21.690134 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:22.240537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9247): Launched 19:56:22.559289 run osmo-msc_10.42.42.6(pid=9248): Launched 19:56:22.737588 run osmo-stp_10.42.42.5(pid=9245): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9245)] 19:56:22.873480 run osmo-stp_10.42.42.5(pid=9245): stdout: | (launched: 2022-12-09_19:56:21.509613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:23.009606 run osmo-stp_10.42.42.5(pid=9245): stderr: | [0;m[38;5;43m20221209195621694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195621694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195621695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195621695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195621695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195621696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195621696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:23.142395 run osmo-stp_10.42.42.5(pid=9245): stdout: | (launched: 2022-12-09_19:56:21.509613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:23.269123 run osmo-stp_10.42.42.5(pid=9245): stderr: | [0;m[38;5;43m20221209195621694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195621694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195621695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195621695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195621695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195621696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195621696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:23.420881 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9245): Process ended prematurely: osmo-stp_10.42.42.5(pid=9245) [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9245)] [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 19:56:23.429716 tst handover.py:18: Test FAILED (6.7 sec) 19:56:23.457134 run osmo-hlr_10.42.42.2(pid=9242): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9242)] 19:56:23.506154 run osmo-hlr_10.42.42.2(pid=9242): stdout: | (launched: 2022-12-09_19:56:20.544297) 19:56:23.556713 run osmo-hlr_10.42.42.2(pid=9242): stderr: | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195620738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195620750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195620759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195620759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195620759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:23.627253 run osmo-msc_10.42.42.6(pid=9248): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9248)] 19:56:23.676225 run osmo-msc_10.42.42.6(pid=9248): stdout: | (launched: 2022-12-09_19:56:22.501098) 19:56:23.726801 run osmo-msc_10.42.42.6(pid=9248): stderr: | [0;m[38;5;43m20221209195622817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195622817 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdcdf5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195622817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195622817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195622817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195622817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195622819 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195622819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195622820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195622820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:23.777629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9241): Terminating (SIGTERM) 19:56:23.818329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9244): Terminating (SIGTERM) 19:56:23.859291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9247): Terminating (SIGTERM) 19:56:23.900274 --- ParallelTerminationStrategy: PID 9241 died... 19:56:23.919719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9241): Terminated: ok {rc=0} 19:56:23.965159 --- ParallelTerminationStrategy: PID 9244 died... 19:56:23.984328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9244): Terminated: ok {rc=0} 19:56:24.029809 --- ParallelTerminationStrategy: PID 9247 died... 19:56:24.048797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9247): Terminated: ok {rc=0} 19:56:24.134847 bus /sierra_3: Setting Powered False 19:56:25.231875 bus /sierra_3: Setting Powered False 19:56:26.345025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 19:56:27.603946 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:27.609472 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 19:56:27.647452 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 19:56:27.674617 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 19:56:27.726768 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 19:56:27.764149 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 19:56:27.791275 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 19:56:28.340690 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 19:56:28.346400 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:28.357418 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:56:28.391934 tst handover.py: using LAC 23352 19:56:28.516764 tst handover.py: using RAC 147 19:56:28.642799 tst handover.py: using CellId 23352 19:56:28.767253 tst handover.py: using BVCI 23353 19:56:28.885393 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:56:28.930985 tst handover.py: using LAC 23353 19:56:29.064748 tst handover.py: using RAC 148 19:56:29.191449 tst handover.py: using CellId 23353 19:56:29.318498 tst handover.py: using BVCI 23354 19:56:29.435215 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:29.446446 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:29.457312 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:29.469173 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:29.480889 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:29.492604 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:56:29.608758 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:56:29.729376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:30.200862 run create_hlr_db(pid=9253): Launched 19:56:30.323459 bus /sierra_2: Setting Powered False 19:56:31.383964 run create_hlr_db(pid=9253): Terminated: ok {rc=0} 19:56:31.841638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Launched 19:56:32.169532 run osmo-hlr_10.42.42.2(pid=9256): Launched 19:56:32.292836 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:32.818475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Launched 19:56:33.139168 run osmo-stp_10.42.42.5(pid=9259): Launched 19:56:33.260359 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:33.810192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9261): Launched 19:56:34.129679 run osmo-msc_10.42.42.6(pid=9262): Launched 19:56:34.307364 run osmo-stp_10.42.42.5(pid=9259): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] 19:56:34.443147 run osmo-stp_10.42.42.5(pid=9259): stdout: | (launched: 2022-12-09_19:56:33.081198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:34.578865 run osmo-stp_10.42.42.5(pid=9259): stderr: | [0;m[38;5;43m20221209195633267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195633267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195633268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195633268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:34.713296 run osmo-stp_10.42.42.5(pid=9259): stdout: | (launched: 2022-12-09_19:56:33.081198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:34.841383 run osmo-stp_10.42.42.5(pid=9259): stderr: | [0;m[38;5;43m20221209195633267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195633267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195633268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195633268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195633269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:34.995442 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9259): Process ended prematurely: osmo-stp_10.42.42.5(pid=9259) [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 19:56:35.004300 tst handover.py:18: Test FAILED (6.7 sec) 19:56:35.032060 run osmo-hlr_10.42.42.2(pid=9256): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9256)] 19:56:35.081293 run osmo-hlr_10.42.42.2(pid=9256): stdout: | (launched: 2022-12-09_19:56:32.111202) 19:56:35.132007 run osmo-hlr_10.42.42.2(pid=9256): stderr: | [0;m[1;31m20221209195632303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195632303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195632303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195632303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195632303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195632304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195632316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195632325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195632325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195632325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:35.202497 run osmo-msc_10.42.42.6(pid=9262): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9262)] 19:56:35.251553 run osmo-msc_10.42.42.6(pid=9262): stdout: | (launched: 2022-12-09_19:56:34.071440) 19:56:35.302096 run osmo-msc_10.42.42.6(pid=9262): stderr: | [0;m[38;5;43m20221209195634390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195634390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd39e5a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195634390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195634390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195634390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195634391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195634392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195634393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195634393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195634393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:35.353279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Terminating (SIGTERM) 19:56:35.394288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Terminating (SIGTERM) 19:56:35.435358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9261): Terminating (SIGTERM) 19:56:35.476558 --- ParallelTerminationStrategy: PID 9255 died... 19:56:35.496103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Terminated: ok {rc=0} 19:56:35.541771 --- ParallelTerminationStrategy: PID 9258 died... 19:56:35.560826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Terminated: ok {rc=0} 19:56:35.606210 --- ParallelTerminationStrategy: PID 9261 died... 19:56:35.625296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9261): Terminated: ok {rc=0} 19:56:35.710949 bus /sierra_3: Setting Powered False 19:56:36.807937 bus /sierra_3: Setting Powered False 19:56:37.921991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 19:56:39.163589 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:39.168915 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:56:39.219404 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:56:39.245386 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:56:39.295477 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:56:39.344865 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:56:39.370733 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:56:39.923008 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 19:56:39.928390 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:39.939116 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:56:39.973688 tst handover.py: using LAC 23354 19:56:40.093041 tst handover.py: using RAC 149 19:56:40.209302 tst handover.py: using CellId 23354 19:56:40.325022 tst handover.py: using BVCI 23355 19:56:40.432674 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:56:40.478960 tst handover.py: using LAC 23355 19:56:40.596679 tst handover.py: using RAC 150 19:56:40.712021 tst handover.py: using CellId 23355 19:56:40.827067 tst handover.py: using BVCI 23356 19:56:40.935340 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:40.946075 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:40.956461 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:40.967357 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:40.978035 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:40.988534 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:56:41.105931 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:56:41.224454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:41.693722 run create_hlr_db(pid=9267): Launched 19:56:41.815633 bus /sierra_2: Setting Powered False 19:56:42.878147 run create_hlr_db(pid=9267): Terminated: ok {rc=0} 19:56:43.281608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9269): Launched 19:56:43.580069 run osmo-hlr_10.42.42.2(pid=9270): Launched 19:56:43.694175 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:44.181146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9272): Launched 19:56:44.478539 run osmo-stp_10.42.42.5(pid=9273): Launched 19:56:44.592522 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:45.105709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9275): Launched 19:56:45.402783 run osmo-msc_10.42.42.6(pid=9276): Launched 19:56:45.568834 run osmo-stp_10.42.42.5(pid=9273): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9273)] 19:56:45.694890 run osmo-stp_10.42.42.5(pid=9273): stdout: | (launched: 2022-12-09_19:56:44.424184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:45.820433 run osmo-stp_10.42.42.5(pid=9273): stderr: | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195644590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195644590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195644590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195644591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:45.979272 run osmo-stp_10.42.42.5(pid=9273): stdout: | (launched: 2022-12-09_19:56:44.424184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:46.101571 run osmo-stp_10.42.42.5(pid=9273): stderr: | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195644589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195644590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195644590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195644590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195644591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:46.273254 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9273): Process ended prematurely: osmo-stp_10.42.42.5(pid=9273) [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9273)] [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 19:56:46.288277 tst handover.py:18: Test FAILED (6.3 sec) 19:56:46.327992 run osmo-hlr_10.42.42.2(pid=9270): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9270)] 19:56:46.379322 run osmo-hlr_10.42.42.2(pid=9270): stdout: | (launched: 2022-12-09_19:56:43.525169) 19:56:46.431254 run osmo-hlr_10.42.42.2(pid=9270): stderr: | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195643697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195643710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195643718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195643718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195643719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:46.499004 run osmo-msc_10.42.42.6(pid=9276): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9276)] 19:56:46.546231 run osmo-msc_10.42.42.6(pid=9276): stdout: | (launched: 2022-12-09_19:56:45.348213) 19:56:46.595335 run osmo-msc_10.42.42.6(pid=9276): stderr: | [0;m[38;5;43m20221209195645614 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195645614 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f209cc5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195645614 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195645614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195645615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195645615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195645616 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195645617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195645617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195645617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:46.644411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9269): Terminating (SIGTERM) 19:56:46.684505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9272): Terminating (SIGTERM) 19:56:46.725539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9275): Terminating (SIGTERM) 19:56:46.765461 --- ParallelTerminationStrategy: PID 9269 died... 19:56:46.784158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9269): Terminated: ok {rc=0} 19:56:46.827975 --- ParallelTerminationStrategy: PID 9272 died... 19:56:46.847084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9272): Terminated: ok {rc=0} 19:56:46.891113 --- ParallelTerminationStrategy: PID 9275 died... 19:56:46.909737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9275): Terminated: ok {rc=0} 19:56:46.993055 bus /sierra_3: Setting Powered False 19:56:48.086058 bus /sierra_3: Setting Powered False 19:56:49.198641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:56:50.455839 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:50.461429 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:56:50.509336 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:56:50.536198 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:56:50.587801 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:56:50.634587 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:56:50.661374 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:56:51.214719 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:56:51.220302 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:51.231520 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:56:51.266954 tst handover.py: using LAC 23356 19:56:51.393351 tst handover.py: using RAC 151 19:56:51.518257 tst handover.py: using CellId 23356 19:56:51.644360 tst handover.py: using BVCI 23357 19:56:51.759975 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:56:51.805504 tst handover.py: using LAC 23357 19:56:51.927076 tst handover.py: using RAC 152 19:56:52.046369 tst handover.py: using CellId 23357 19:56:52.166591 tst handover.py: using BVCI 23358 19:56:52.284718 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:52.296116 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:52.307241 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:52.318637 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:52.330126 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:52.341618 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:56:52.456599 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:56:52.570950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:53.040747 run create_hlr_db(pid=9281): Launched 19:56:53.163676 bus /sierra_2: Setting Powered False 19:56:54.227179 run create_hlr_db(pid=9281): Terminated: ok {rc=0} 19:56:54.645223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Launched 19:56:54.964302 run osmo-hlr_10.42.42.2(pid=9284): Launched 19:56:55.086654 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:55.610010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Launched 19:56:55.929636 run osmo-stp_10.42.42.5(pid=9287): Launched 19:56:56.052630 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:56.605126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9289): Launched 19:56:56.925303 run osmo-msc_10.42.42.6(pid=9290): Launched 19:56:57.105677 run osmo-stp_10.42.42.5(pid=9287): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] 19:56:57.241178 run osmo-stp_10.42.42.5(pid=9287): stdout: | (launched: 2022-12-09_19:56:55.871500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:57.377271 run osmo-stp_10.42.42.5(pid=9287): stderr: | [0;m[38;5;43m20221209195656058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195656059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195656059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195656059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:57.511454 run osmo-stp_10.42.42.5(pid=9287): stdout: | (launched: 2022-12-09_19:56:55.871500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:57.639650 run osmo-stp_10.42.42.5(pid=9287): stderr: | [0;m[38;5;43m20221209195656058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195656059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195656059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195656059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:57.792782 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9287): Process ended prematurely: osmo-stp_10.42.42.5(pid=9287) [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 19:56:57.801612 tst handover.py:18: Test FAILED (6.6 sec) 19:56:57.829328 run osmo-hlr_10.42.42.2(pid=9284): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9284)] 19:56:57.878736 run osmo-hlr_10.42.42.2(pid=9284): stdout: | (launched: 2022-12-09_19:56:54.906365) 19:56:57.929504 run osmo-hlr_10.42.42.2(pid=9284): stderr: | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195655098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195655110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195655119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195655119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195655119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:58.000651 run osmo-msc_10.42.42.6(pid=9290): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9290)] 19:56:58.050149 run osmo-msc_10.42.42.6(pid=9290): stdout: | (launched: 2022-12-09_19:56:56.867073) 19:56:58.101138 run osmo-msc_10.42.42.6(pid=9290): stderr: | [0;m[38;5;43m20221209195657183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195657183 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e7ad33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195657183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195657183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195657184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195657184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195657186 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195657186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195657186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195657186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:58.152444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Terminating (SIGTERM) 19:56:58.193498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Terminating (SIGTERM) 19:56:58.234535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9289): Terminating (SIGTERM) 19:56:58.275867 --- ParallelTerminationStrategy: PID 9283 died... 19:56:58.295393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Terminated: ok {rc=0} 19:56:58.340926 --- ParallelTerminationStrategy: PID 9286 died... 19:56:58.360101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Terminated: ok {rc=0} 19:56:58.405597 --- ParallelTerminationStrategy: PID 9289 died... 19:56:58.424701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9289): Terminated: ok {rc=0} 19:56:58.510149 bus /sierra_3: Setting Powered False 19:56:59.606167 bus /sierra_3: Setting Powered False 19:57:00.718975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:57:01.985254 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:01.996735 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:57:02.069267 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:57:02.103143 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:57:02.163005 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:57:02.215931 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:57:02.244006 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:57:02.793061 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:57:02.798592 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:02.809999 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:57:02.847886 tst handover.py: using LAC 23358 19:57:02.973054 tst handover.py: using RAC 153 19:57:03.097537 tst handover.py: using CellId 23358 19:57:03.222000 tst handover.py: using BVCI 23359 19:57:03.338520 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:57:03.387182 tst handover.py: using LAC 23359 19:57:03.513260 tst handover.py: using RAC 154 19:57:03.637584 tst handover.py: using CellId 23359 19:57:03.756667 tst handover.py: using BVCI 23360 19:57:03.865867 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:03.876755 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:03.887603 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:03.899039 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:03.910476 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:57:03.921898 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:57:04.042161 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:57:04.157251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:04.595165 run create_hlr_db(pid=9295): Launched 19:57:04.717361 bus /sierra_2: Setting Powered False 19:57:05.775962 run create_hlr_db(pid=9295): Terminated: ok {rc=0} 19:57:06.168045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Launched 19:57:06.467342 run osmo-hlr_10.42.42.2(pid=9298): Launched 19:57:06.581222 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:07.070253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Launched 19:57:07.368845 run osmo-stp_10.42.42.5(pid=9301): Launched 19:57:07.483501 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:07.997985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Launched 19:57:08.296708 run osmo-msc_10.42.42.6(pid=9304): Launched 19:57:08.462789 run osmo-stp_10.42.42.5(pid=9301): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] 19:57:08.588275 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-09_19:57:07.314356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:08.713986 run osmo-stp_10.42.42.5(pid=9301): stderr: | [0;m[38;5;43m20221209195707479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195707479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195707480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195707480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195707480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195707481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195707481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:08.838557 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-09_19:57:07.314356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:08.957695 run osmo-stp_10.42.42.5(pid=9301): stderr: | [0;m[38;5;43m20221209195707479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195707479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195707480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195707480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195707480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195707481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195707481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:09.100150 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 19:57:09.108489 tst handover.py:18: Test FAILED (6.3 sec) 19:57:09.134653 run osmo-hlr_10.42.42.2(pid=9298): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9298)] 19:57:09.181792 run osmo-hlr_10.42.42.2(pid=9298): stdout: | (launched: 2022-12-09_19:57:06.412257) 19:57:09.230062 run osmo-hlr_10.42.42.2(pid=9298): stderr: | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195706585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195706597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195706606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195706606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195706606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:09.297439 run osmo-msc_10.42.42.6(pid=9304): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9304)] 19:57:09.344189 run osmo-msc_10.42.42.6(pid=9304): stdout: | (launched: 2022-12-09_19:57:08.241993) 19:57:09.392013 run osmo-msc_10.42.42.6(pid=9304): stderr: | [0;m[38;5;43m20221209195708510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195708510 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe22127fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195708511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195708511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195708511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195708511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195708513 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195708513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195708514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195708514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:09.440550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminating (SIGTERM) 19:57:09.479210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminating (SIGTERM) 19:57:09.518257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminating (SIGTERM) 19:57:09.557327 --- ParallelTerminationStrategy: PID 9297 died... 19:57:09.575906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminated: ok {rc=0} 19:57:09.618933 --- ParallelTerminationStrategy: PID 9300 died... 19:57:09.637190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminated: ok {rc=0} 19:57:09.680064 --- ParallelTerminationStrategy: PID 9303 died... 19:57:09.698222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminated: ok {rc=0} 19:57:09.783058 bus /sierra_3: Setting Powered False 19:57:10.882164 bus /sierra_3: Setting Powered False 19:57:11.996009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 19:57:13.254986 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:13.260474 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:57:13.300197 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:57:13.327418 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:57:13.380238 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:57:13.419508 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:57:13.446603 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:57:13.995843 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 19:57:14.001533 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:14.012704 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:57:14.048221 tst handover.py: using LAC 23360 19:57:14.173180 tst handover.py: using RAC 155 19:57:14.298255 tst handover.py: using CellId 23360 19:57:14.431753 tst handover.py: using BVCI 23361 19:57:14.559384 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:57:14.599379 tst handover.py: using LAC 23361 19:57:14.726384 tst handover.py: using RAC 156 19:57:14.854007 tst handover.py: using CellId 23361 19:57:14.978905 tst handover.py: using BVCI 23362 19:57:15.095822 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:15.106886 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:15.117833 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:15.129008 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:15.140129 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:15.151316 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:57:15.267486 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:57:15.384154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:15.869635 run create_hlr_db(pid=9309): Launched 19:57:16.030021 bus /sierra_2: Setting Powered False 19:57:17.092636 run create_hlr_db(pid=9309): Terminated: ok {rc=0} 19:57:17.518984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Launched 19:57:17.838715 run osmo-hlr_10.42.42.2(pid=9312): Launched 19:57:17.961141 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:18.482464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Launched 19:57:18.801341 run osmo-stp_10.42.42.5(pid=9315): Launched 19:57:18.923581 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:19.475945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Launched 19:57:19.796231 run osmo-msc_10.42.42.6(pid=9318): Launched 19:57:19.975207 run osmo-stp_10.42.42.5(pid=9315): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] 19:57:20.111837 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-09_19:57:18.743168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:20.247886 run osmo-stp_10.42.42.5(pid=9315): stderr: | [0;m[38;5;43m20221209195718929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195718929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195718930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195718930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:20.381437 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-09_19:57:18.743168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:20.509296 run osmo-stp_10.42.42.5(pid=9315): stderr: | [0;m[38;5;43m20221209195718929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195718929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195718930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195718930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195718931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:20.662476 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 19:57:20.671400 tst handover.py:18: Test FAILED (6.7 sec) 19:57:20.699036 run osmo-hlr_10.42.42.2(pid=9312): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9312)] 19:57:20.748309 run osmo-hlr_10.42.42.2(pid=9312): stdout: | (launched: 2022-12-09_19:57:17.780570) 19:57:20.798957 run osmo-hlr_10.42.42.2(pid=9312): stderr: | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195717973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195717986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195717995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195717995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195717995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:20.869703 run osmo-msc_10.42.42.6(pid=9318): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9318)] 19:57:20.918792 run osmo-msc_10.42.42.6(pid=9318): stdout: | (launched: 2022-12-09_19:57:19.737725) 19:57:20.969264 run osmo-msc_10.42.42.6(pid=9318): stderr: | [0;m[38;5;43m20221209195720052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195720052 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff63c53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195720053 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195720053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195720053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195720053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195720055 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195720055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195720055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195720055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:21.020404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminating (SIGTERM) 19:57:21.061728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminating (SIGTERM) 19:57:21.102479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminating (SIGTERM) 19:57:21.143567 --- ParallelTerminationStrategy: PID 9311 died... 19:57:21.163124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminated: ok {rc=0} 19:57:21.208804 --- ParallelTerminationStrategy: PID 9314 died... 19:57:21.227877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminated: ok {rc=0} 19:57:21.273735 --- ParallelTerminationStrategy: PID 9317 died... 19:57:21.292525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminated: ok {rc=0} 19:57:21.378714 bus /sierra_3: Setting Powered False 19:57:22.478276 bus /sierra_3: Setting Powered False 19:57:23.591668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 19:57:24.826856 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:24.832004 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:57:24.881078 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:57:24.906843 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:57:24.956898 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:57:25.005861 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:57:25.031744 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:57:25.585024 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 19:57:25.590216 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:25.600613 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:57:25.633973 tst handover.py: using LAC 23362 19:57:25.751607 tst handover.py: using RAC 157 19:57:25.868699 tst handover.py: using CellId 23362 19:57:25.984665 tst handover.py: using BVCI 23363 19:57:26.092426 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:57:26.139720 tst handover.py: using LAC 23363 19:57:26.271205 tst handover.py: using RAC 158 19:57:26.396021 tst handover.py: using CellId 23363 19:57:26.513422 tst handover.py: using BVCI 23364 19:57:26.621098 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:26.631581 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:26.642078 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:26.652444 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:26.662947 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:26.673326 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:57:26.789827 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:57:26.903443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:27.342587 run create_hlr_db(pid=9323): Launched 19:57:27.465235 bus /sierra_2: Setting Powered False 19:57:28.524664 run create_hlr_db(pid=9323): Terminated: ok {rc=0} 19:57:28.915855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9325): Launched 19:57:29.214272 run osmo-hlr_10.42.42.2(pid=9326): Launched 19:57:29.327435 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:29.814488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9328): Launched 19:57:30.112296 run osmo-stp_10.42.42.5(pid=9329): Launched 19:57:30.225543 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:30.740784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9331): Launched 19:57:31.082171 run osmo-msc_10.42.42.6(pid=9332): Launched 19:57:31.354490 run osmo-stp_10.42.42.5(pid=9329): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9329)] 19:57:31.744125 run osmo-stp_10.42.42.5(pid=9329): stdout: | (launched: 2022-12-09_19:57:30.057685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:31.946843 run osmo-stp_10.42.42.5(pid=9329): stderr: | [0;m[38;5;43m20221209195730223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195730223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195730224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195730224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195730224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195730225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195730225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:32.095802 run osmo-stp_10.42.42.5(pid=9329): stdout: | (launched: 2022-12-09_19:57:30.057685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:32.261441 run osmo-stp_10.42.42.5(pid=9329): stderr: | [0;m[38;5;43m20221209195730223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195730223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195730224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195730224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195730224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195730225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195730225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:32.407342 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9329): Process ended prematurely: osmo-stp_10.42.42.5(pid=9329) [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9329)] [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 19:57:32.415891 tst handover.py:18: Test FAILED (6.8 sec) 19:57:32.441622 run osmo-hlr_10.42.42.2(pid=9326): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9326)] 19:57:32.488332 run osmo-hlr_10.42.42.2(pid=9326): stdout: | (launched: 2022-12-09_19:57:29.159311) 19:57:32.536487 run osmo-hlr_10.42.42.2(pid=9326): stderr: | [0;m[1;31m20221209195729333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195729333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195729333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195729333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195729333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195729334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195729346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195729356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195729357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195729357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:32.603750 run osmo-msc_10.42.42.6(pid=9332): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9332)] 19:57:32.650799 run osmo-msc_10.42.42.6(pid=9332): stdout: | (launched: 2022-12-09_19:57:31.015507) 19:57:32.699129 run osmo-msc_10.42.42.6(pid=9332): stderr: | [0;m[38;5;43m20221209195731532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195731533 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2d9f5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195731533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195731533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195731534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195731534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195731539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195731540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195731541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195731541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:32.747628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9325): Terminating (SIGTERM) 19:57:32.786267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9328): Terminating (SIGTERM) 19:57:32.824731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9331): Terminating (SIGTERM) 19:57:32.863514 --- ParallelTerminationStrategy: PID 9325 died... 19:57:32.882107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9325): Terminated: ok {rc=0} 19:57:32.924770 --- ParallelTerminationStrategy: PID 9328 died... 19:57:32.942930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9328): Terminated: ok {rc=0} 19:57:32.985484 --- ParallelTerminationStrategy: PID 9331 died... 19:57:33.003752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9331): Terminated: ok {rc=0} 19:57:33.087712 bus /sierra_3: Setting Powered False 19:57:34.184593 bus /sierra_3: Setting Powered False 19:57:35.294933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 19:57:36.545188 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:36.550438 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:57:36.599625 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:57:36.625732 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:57:36.677945 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:57:36.727269 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:57:36.753135 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:57:37.301378 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 19:57:37.306662 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:37.317519 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:57:37.351946 tst handover.py: using LAC 23364 19:57:37.475732 tst handover.py: using RAC 159 19:57:37.594708 tst handover.py: using CellId 23364 19:57:37.711244 tst handover.py: using BVCI 23365 19:57:37.820549 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:57:37.866608 tst handover.py: using LAC 23365 19:57:37.993079 tst handover.py: using RAC 160 19:57:38.110804 tst handover.py: using CellId 23365 19:57:38.227944 tst handover.py: using BVCI 23366 19:57:38.337251 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:38.348185 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:38.358877 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:38.369765 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:38.380548 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:38.391157 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:57:38.504087 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:57:38.622220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:39.098757 run create_hlr_db(pid=9339): Launched 19:57:39.224039 bus /sierra_2: Setting Powered False 19:57:40.288860 run create_hlr_db(pid=9339): Terminated: ok {rc=0} 19:57:40.713994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9341): Launched 19:57:41.039222 run osmo-hlr_10.42.42.2(pid=9342): Launched 19:57:41.164475 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:41.697732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9344): Launched 19:57:42.021781 run osmo-stp_10.42.42.5(pid=9345): Launched 19:57:42.144929 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:42.703727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9347): Launched 19:57:43.029780 run osmo-msc_10.42.42.6(pid=9348): Launched 19:57:43.211986 run osmo-stp_10.42.42.5(pid=9345): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9345)] 19:57:43.349821 run osmo-stp_10.42.42.5(pid=9345): stdout: | (launched: 2022-12-09_19:57:41.962593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:43.488017 run osmo-stp_10.42.42.5(pid=9345): stderr: | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195742151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:43.623772 run osmo-stp_10.42.42.5(pid=9345): stdout: | (launched: 2022-12-09_19:57:41.962593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:43.754508 run osmo-stp_10.42.42.5(pid=9345): stderr: | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195742150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195742151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195742151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:43.910436 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9345): Process ended prematurely: osmo-stp_10.42.42.5(pid=9345) [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9345)] [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 19:57:43.919454 tst handover.py:18: Test FAILED (6.6 sec) 19:57:43.947258 run osmo-hlr_10.42.42.2(pid=9342): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9342)] 19:57:43.997663 run osmo-hlr_10.42.42.2(pid=9342): stdout: | (launched: 2022-12-09_19:57:40.979379) 19:57:44.049407 run osmo-hlr_10.42.42.2(pid=9342): stderr: | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195741173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195741185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195741194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195741194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195741194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:44.120440 run osmo-msc_10.42.42.6(pid=9348): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9348)] 19:57:44.169630 run osmo-msc_10.42.42.6(pid=9348): stdout: | (launched: 2022-12-09_19:57:42.970026) 19:57:44.220599 run osmo-msc_10.42.42.6(pid=9348): stderr: | [0;m[38;5;43m20221209195743286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195743286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1289414c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195743286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195743287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195743287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195743287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195743289 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195743289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195743289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195743289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:44.271930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9341): Terminating (SIGTERM) 19:57:44.312861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9344): Terminating (SIGTERM) 19:57:44.354560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9347): Terminating (SIGTERM) 19:57:44.396527 --- ParallelTerminationStrategy: PID 9341 died... 19:57:44.416215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9341): Terminated: ok {rc=0} 19:57:44.462574 --- ParallelTerminationStrategy: PID 9344 died... 19:57:44.481798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9344): Terminated: ok {rc=0} 19:57:44.527856 --- ParallelTerminationStrategy: PID 9347 died... 19:57:44.547078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9347): Terminated: ok {rc=0} 19:57:44.633775 bus /sierra_3: Setting Powered False 19:57:45.732100 bus /sierra_3: Setting Powered False 19:57:46.847268 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 19:57:48.099775 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:48.105113 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:57:48.153353 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:57:48.179635 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:57:48.229941 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:57:48.278136 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:57:48.304099 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:57:48.855062 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 19:57:48.860372 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:48.871091 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:57:48.903815 tst handover.py: using LAC 23366 19:57:49.023140 tst handover.py: using RAC 161 19:57:49.143649 tst handover.py: using CellId 23366 19:57:49.264145 tst handover.py: using BVCI 23367 19:57:49.375401 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:57:49.422857 tst handover.py: using LAC 23367 19:57:49.544661 tst handover.py: using RAC 162 19:57:49.665225 tst handover.py: using CellId 23367 19:57:49.784105 tst handover.py: using BVCI 23368 19:57:49.893975 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:49.904714 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:49.915264 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:49.925786 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:49.936296 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:49.946842 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:57:50.065559 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:57:50.181151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:50.657477 run create_hlr_db(pid=9353): Launched 19:57:50.782189 bus /sierra_2: Setting Powered False 19:57:51.846869 run create_hlr_db(pid=9353): Terminated: ok {rc=0} 19:57:52.297404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9355): Launched 19:57:52.623305 run osmo-hlr_10.42.42.2(pid=9356): Launched 19:57:52.747113 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:53.278313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9358): Launched 19:57:53.605234 run osmo-stp_10.42.42.5(pid=9359): Launched 19:57:53.729801 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:54.295497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9361): Launched 19:57:54.622592 run osmo-msc_10.42.42.6(pid=9362): Launched 19:57:54.804586 run osmo-stp_10.42.42.5(pid=9359): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9359)] 19:57:54.941736 run osmo-stp_10.42.42.5(pid=9359): stdout: | (launched: 2022-12-09_19:57:53.545667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:55.080080 run osmo-stp_10.42.42.5(pid=9359): stderr: | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195753733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:55.216107 run osmo-stp_10.42.42.5(pid=9359): stdout: | (launched: 2022-12-09_19:57:53.545667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:55.346995 run osmo-stp_10.42.42.5(pid=9359): stderr: | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195753733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195753733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195753734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:55.502619 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9359): Process ended prematurely: osmo-stp_10.42.42.5(pid=9359) [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9359)] [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 19:57:55.511664 tst handover.py:18: Test FAILED (6.6 sec) 19:57:55.539168 run osmo-hlr_10.42.42.2(pid=9356): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9356)] 19:57:55.589546 run osmo-hlr_10.42.42.2(pid=9356): stdout: | (launched: 2022-12-09_19:57:52.563628) 19:57:55.640851 run osmo-hlr_10.42.42.2(pid=9356): stderr: | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195752759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195752772 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195752780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195752781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195752781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:55.712401 run osmo-msc_10.42.42.6(pid=9362): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9362)] 19:57:55.762078 run osmo-msc_10.42.42.6(pid=9362): stdout: | (launched: 2022-12-09_19:57:54.563130) 19:57:55.813447 run osmo-msc_10.42.42.6(pid=9362): stderr: | [0;m[38;5;43m20221209195754879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195754879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1056d8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195754880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195754880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195754880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195754880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195754882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195754882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195754882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195754882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:55.864753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9355): Terminating (SIGTERM) 19:57:55.906296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9358): Terminating (SIGTERM) 19:57:55.947834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9361): Terminating (SIGTERM) 19:57:55.989482 --- ParallelTerminationStrategy: PID 9355 died... 19:57:56.009169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9355): Terminated: ok {rc=0} 19:57:56.055609 --- ParallelTerminationStrategy: PID 9358 died... 19:57:56.075293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9358): Terminated: ok {rc=0} 19:57:56.121207 --- ParallelTerminationStrategy: PID 9361 died... 19:57:56.140269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9361): Terminated: ok {rc=0} 19:57:56.226633 bus /sierra_3: Setting Powered False 19:57:57.326325 bus /sierra_3: Setting Powered False 19:57:58.442324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:57:59.695817 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:59.701554 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:57:59.747899 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:57:59.774716 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:57:59.826906 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:57:59.872715 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:57:59.899470 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:58:00.454499 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:58:00.460112 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:00.471632 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:00.506510 tst handover.py: using LAC 23368 19:58:00.639298 tst handover.py: using RAC 163 19:58:00.765784 tst handover.py: using CellId 23368 19:58:00.921600 tst handover.py: using BVCI 23369 19:58:01.044486 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:01.088374 tst handover.py: using LAC 23369 19:58:01.256730 tst handover.py: using RAC 164 19:58:01.385297 tst handover.py: using CellId 23369 19:58:01.532532 tst handover.py: using BVCI 23370 19:58:01.684830 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:01.699411 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:01.713948 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:01.727566 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:01.743348 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:01.756724 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:01.896821 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:02.018571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:02.471749 run create_hlr_db(pid=9367): Launched 19:58:02.596925 bus /sierra_2: Setting Powered False 19:58:03.657627 run create_hlr_db(pid=9367): Terminated: ok {rc=0} 19:58:04.055119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9369): Launched 19:58:04.359629 run osmo-hlr_10.42.42.2(pid=9370): Launched 19:58:04.474858 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:04.970544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9372): Launched 19:58:05.273228 run osmo-stp_10.42.42.5(pid=9373): Launched 19:58:05.388741 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:05.910664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9375): Launched 19:58:06.214566 run osmo-msc_10.42.42.6(pid=9376): Launched 19:58:06.399122 run osmo-stp_10.42.42.5(pid=9373): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9373)] 19:58:06.538722 run osmo-stp_10.42.42.5(pid=9373): stdout: | (launched: 2022-12-09_19:58:05.217322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:06.678824 run osmo-stp_10.42.42.5(pid=9373): stderr: | [0;m[38;5;43m20221209195805384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195805384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195805385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195805385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195805385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195805386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195805386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:06.814437 run osmo-stp_10.42.42.5(pid=9373): stdout: | (launched: 2022-12-09_19:58:05.217322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:06.944747 run osmo-stp_10.42.42.5(pid=9373): stderr: | [0;m[38;5;43m20221209195805384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195805384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195805385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195805385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195805385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195805386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195805386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:07.100787 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9373): Process ended prematurely: osmo-stp_10.42.42.5(pid=9373) [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9373)] [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 19:58:07.110057 tst handover.py:18: Test FAILED (6.6 sec) 19:58:07.138223 run osmo-hlr_10.42.42.2(pid=9370): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9370)] 19:58:07.188685 run osmo-hlr_10.42.42.2(pid=9370): stdout: | (launched: 2022-12-09_19:58:04.303564) 19:58:07.241102 run osmo-hlr_10.42.42.2(pid=9370): stderr: | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195804479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195804494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195804502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195804503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195804503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:07.313441 run osmo-msc_10.42.42.6(pid=9376): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9376)] 19:58:07.363720 run osmo-msc_10.42.42.6(pid=9376): stdout: | (launched: 2022-12-09_19:58:06.158597) 19:58:07.415974 run osmo-msc_10.42.42.6(pid=9376): stderr: | [0;m[38;5;43m20221209195806470 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195806470 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa751d7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195806470 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195806470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195806470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195806471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195806472 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195806473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195806473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195806473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:07.468249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9369): Terminating (SIGTERM) 19:58:07.510473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9372): Terminating (SIGTERM) 19:58:07.552668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9375): Terminating (SIGTERM) 19:58:07.595108 --- ParallelTerminationStrategy: PID 9369 died... 19:58:07.615067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9369): Terminated: ok {rc=0} 19:58:07.661802 --- ParallelTerminationStrategy: PID 9372 died... 19:58:07.681447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9372): Terminated: ok {rc=0} 19:58:07.727875 --- ParallelTerminationStrategy: PID 9375 died... 19:58:07.747383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9375): Terminated: ok {rc=0} 19:58:07.835137 bus /sierra_3: Setting Powered False 19:58:08.932037 bus /sierra_3: Setting Powered False 19:58:10.050272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:58:11.300625 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:11.305824 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:58:11.354299 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:58:11.380237 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:58:11.431118 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:58:11.479515 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:58:11.505529 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:58:12.058429 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:58:12.063805 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:12.074689 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:58:12.107635 tst handover.py: using LAC 23370 19:58:12.237570 tst handover.py: using RAC 165 19:58:12.357101 tst handover.py: using CellId 23370 19:58:12.476198 tst handover.py: using BVCI 23371 19:58:12.585988 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:58:12.634254 tst handover.py: using LAC 23371 19:58:12.755963 tst handover.py: using RAC 166 19:58:12.877219 tst handover.py: using CellId 23371 19:58:12.995896 tst handover.py: using BVCI 23372 19:58:13.107071 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:13.117954 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:13.128572 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:13.139240 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:13.150074 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:13.160637 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:58:13.279238 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:58:13.399719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:13.876467 run create_hlr_db(pid=9382): Launched 19:58:14.000530 bus /sierra_2: Setting Powered False 19:58:15.065277 run create_hlr_db(pid=9382): Terminated: ok {rc=0} 19:58:15.488765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Launched 19:58:15.813686 run osmo-hlr_10.42.42.2(pid=9385): Launched 19:58:16.076144 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:16.638052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Launched 19:58:16.972313 run osmo-stp_10.42.42.5(pid=9388): Launched 19:58:17.242555 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:17.804663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9390): Launched 19:58:18.132293 run osmo-msc_10.42.42.6(pid=9391): Launched 19:58:18.314814 run osmo-stp_10.42.42.5(pid=9388): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] 19:58:18.453717 run osmo-stp_10.42.42.5(pid=9388): stdout: | (launched: 2022-12-09_19:58:16.910396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:18.592666 run osmo-stp_10.42.42.5(pid=9388): stderr: | [0;m[38;5;43m20221209195817109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195817110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195817110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195817110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:18.730030 run osmo-stp_10.42.42.5(pid=9388): stdout: | (launched: 2022-12-09_19:58:16.910396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:18.860667 run osmo-stp_10.42.42.5(pid=9388): stderr: | [0;m[38;5;43m20221209195817109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195817110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195817110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195817110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195817111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:19.017158 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9388): Process ended prematurely: osmo-stp_10.42.42.5(pid=9388) [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 19:58:19.026235 tst handover.py:18: Test FAILED (7.0 sec) 19:58:19.054600 run osmo-hlr_10.42.42.2(pid=9385): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9385)] 19:58:19.104523 run osmo-hlr_10.42.42.2(pid=9385): stdout: | (launched: 2022-12-09_19:58:15.754394) 19:58:19.155987 run osmo-hlr_10.42.42.2(pid=9385): stderr: | [0;m[1;31m20221209195816011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195816011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195816012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195816012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195816016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195816016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195816031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195816043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195816044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195816044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:19.226983 run osmo-msc_10.42.42.6(pid=9391): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9391)] 19:58:19.276543 run osmo-msc_10.42.42.6(pid=9391): stdout: | (launched: 2022-12-09_19:58:18.071705) 19:58:19.327470 run osmo-msc_10.42.42.6(pid=9391): stderr: | [0;m[38;5;43m20221209195818389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195818389 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f08542b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195818389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195818389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195818389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195818390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195818391 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195818392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195818392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195818392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:19.378818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Terminating (SIGTERM) 19:58:19.420308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Terminating (SIGTERM) 19:58:19.461521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9390): Terminating (SIGTERM) 19:58:19.504093 --- ParallelTerminationStrategy: PID 9384 died... 19:58:19.524012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Terminated: ok {rc=0} 19:58:19.570923 --- ParallelTerminationStrategy: PID 9387 died... 19:58:19.590519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Terminated: ok {rc=0} 19:58:19.637132 --- ParallelTerminationStrategy: PID 9390 died... 19:58:19.656656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9390): Terminated: ok {rc=0} 19:58:19.744394 bus /sierra_3: Setting Powered False 19:58:20.842732 bus /sierra_3: Setting Powered False 19:58:21.959508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 19:58:23.216133 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:23.221482 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:58:23.257804 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:58:23.283828 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:58:23.334662 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:58:23.370783 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:58:23.396790 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:58:23.950274 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 19:58:23.956012 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:23.967337 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:58:24.002383 tst handover.py: using LAC 23372 19:58:24.133433 tst handover.py: using RAC 167 19:58:24.256669 tst handover.py: using CellId 23372 19:58:24.376504 tst handover.py: using BVCI 23373 19:58:24.487047 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:58:24.520917 tst handover.py: using LAC 23373 19:58:24.638946 tst handover.py: using RAC 168 19:58:24.758757 tst handover.py: using CellId 23373 19:58:24.878283 tst handover.py: using BVCI 23374 19:58:24.997817 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:25.009226 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:25.020384 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:25.032045 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:25.044487 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:25.055715 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:58:25.177682 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:58:25.295012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:25.743779 run create_hlr_db(pid=9396): Launched 19:58:25.868748 bus /sierra_2: Setting Powered False 19:58:26.930048 run create_hlr_db(pid=9396): Terminated: ok {rc=0} 19:58:27.330143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Launched 19:58:27.635872 run osmo-hlr_10.42.42.2(pid=9399): Launched 19:58:27.751111 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:28.264481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Launched 19:58:28.569554 run osmo-stp_10.42.42.5(pid=9402): Launched 19:58:28.686561 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:29.211805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Launched 19:58:29.516303 run osmo-msc_10.42.42.6(pid=9405): Launched 19:58:29.686127 run osmo-stp_10.42.42.5(pid=9402): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] 19:58:29.815364 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-09_19:58:28.513320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:29.943370 run osmo-stp_10.42.42.5(pid=9402): stderr: | [0;m[38;5;43m20221209195828680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195828680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195828681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195828681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:30.069264 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-09_19:58:28.513320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:30.190054 run osmo-stp_10.42.42.5(pid=9402): stderr: | [0;m[38;5;43m20221209195828680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195828680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195828681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195828681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195828682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:30.334971 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 19:58:30.343250 tst handover.py:18: Test FAILED (6.4 sec) 19:58:30.368935 run osmo-hlr_10.42.42.2(pid=9399): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9399)] 19:58:30.415689 run osmo-hlr_10.42.42.2(pid=9399): stdout: | (launched: 2022-12-09_19:58:27.579691) 19:58:30.464060 run osmo-hlr_10.42.42.2(pid=9399): stderr: | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195827754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195827765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195827773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195827773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195827773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:30.531860 run osmo-msc_10.42.42.6(pid=9405): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9405)] 19:58:30.578584 run osmo-msc_10.42.42.6(pid=9405): stdout: | (launched: 2022-12-09_19:58:29.460136) 19:58:30.626644 run osmo-msc_10.42.42.6(pid=9405): stderr: | [0;m[38;5;43m20221209195829730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195829730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc23e02bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195829730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195829730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195829730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195829731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195829732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195829733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195829733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195829733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:30.675107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminating (SIGTERM) 19:58:30.713646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminating (SIGTERM) 19:58:30.752143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Terminating (SIGTERM) 19:58:30.790788 --- ParallelTerminationStrategy: PID 9398 died... 19:58:30.809423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminated: ok {rc=0} 19:58:30.866821 --- ParallelTerminationStrategy: PID 9401 died... 19:58:30.892339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminated: ok {rc=0} 19:58:30.946830 --- ParallelTerminationStrategy: PID 9404 died... 19:58:30.967564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Terminated: ok {rc=0} 19:58:31.061244 bus /sierra_3: Setting Powered False 19:58:32.169336 bus /sierra_3: Setting Powered False 19:58:33.297960 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 19:58:34.536205 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:34.541372 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:58:34.589734 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:58:34.615558 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:58:34.667627 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:58:34.715689 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:58:34.741666 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:58:35.290328 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 19:58:35.295405 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:35.306119 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:58:35.339287 tst handover.py: using LAC 23374 19:58:35.460625 tst handover.py: using RAC 169 19:58:35.581400 tst handover.py: using CellId 23374 19:58:35.701234 tst handover.py: using BVCI 23375 19:58:35.812120 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:58:35.861144 tst handover.py: using LAC 23375 19:58:35.981779 tst handover.py: using RAC 170 19:58:36.101305 tst handover.py: using CellId 23375 19:58:36.220627 tst handover.py: using BVCI 23376 19:58:36.332573 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:36.343329 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:36.353906 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:36.364336 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:36.374939 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:36.385456 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:58:36.503611 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:58:36.619648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:37.066065 run create_hlr_db(pid=9410): Launched 19:58:37.190201 bus /sierra_2: Setting Powered False 19:58:38.251172 run create_hlr_db(pid=9410): Terminated: ok {rc=0} 19:58:38.650122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9412): Launched 19:58:38.954364 run osmo-hlr_10.42.42.2(pid=9413): Launched 19:58:39.069466 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:39.567345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9415): Launched 19:58:39.871623 run osmo-stp_10.42.42.5(pid=9416): Launched 19:58:39.989641 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:40.514549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9418): Launched 19:58:40.819686 run osmo-msc_10.42.42.6(pid=9419): Launched 19:58:40.989762 run osmo-stp_10.42.42.5(pid=9416): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9416)] 19:58:41.159552 run osmo-stp_10.42.42.5(pid=9416): stdout: | (launched: 2022-12-09_19:58:39.815261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:41.286265 run osmo-stp_10.42.42.5(pid=9416): stderr: | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195839985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:41.412689 run osmo-stp_10.42.42.5(pid=9416): stdout: | (launched: 2022-12-09_19:58:39.815261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:41.534451 run osmo-stp_10.42.42.5(pid=9416): stderr: | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195839984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195839985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195839985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:41.679527 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9416): Process ended prematurely: osmo-stp_10.42.42.5(pid=9416) [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9416)] [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 19:58:41.687875 tst handover.py:18: Test FAILED (6.4 sec) 19:58:41.713668 run osmo-hlr_10.42.42.2(pid=9413): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9413)] 19:58:41.761152 run osmo-hlr_10.42.42.2(pid=9413): stdout: | (launched: 2022-12-09_19:58:38.898256) 19:58:41.809431 run osmo-hlr_10.42.42.2(pid=9413): stderr: | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195839076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195839133 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195839143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195839143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195839143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:41.877706 run osmo-msc_10.42.42.6(pid=9419): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9419)] 19:58:41.924768 run osmo-msc_10.42.42.6(pid=9419): stdout: | (launched: 2022-12-09_19:58:40.762889) 19:58:41.973287 run osmo-msc_10.42.42.6(pid=9419): stderr: | [0;m[38;5;43m20221209195841033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195841033 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f605d3b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195841034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195841034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195841034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195841034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195841036 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195841036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195841036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195841036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:42.022089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9412): Terminating (SIGTERM) 19:58:42.061251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9415): Terminating (SIGTERM) 19:58:42.100267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9418): Terminating (SIGTERM) 19:58:42.139510 --- ParallelTerminationStrategy: PID 9412 died... 19:58:42.158318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9412): Terminated: ok {rc=0} 19:58:42.201488 --- ParallelTerminationStrategy: PID 9415 died... 19:58:42.219601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9415): Terminated: ok {rc=0} 19:58:42.262857 --- ParallelTerminationStrategy: PID 9418 died... 19:58:42.281228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9418): Terminated: ok {rc=0} 19:58:42.363673 bus /sierra_3: Setting Powered False 19:58:43.458785 bus /sierra_3: Setting Powered False 19:58:44.576243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 19:58:45.827411 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:45.843547 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:58:45.906511 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:58:45.936125 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:58:46.000275 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:58:46.053654 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:58:46.083224 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:58:46.618731 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 19:58:46.627287 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:46.643183 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:58:46.693570 tst handover.py: using LAC 23376 19:58:46.827853 tst handover.py: using RAC 171 19:58:46.963409 tst handover.py: using CellId 23376 19:58:47.086521 tst handover.py: using BVCI 23377 19:58:47.199488 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:58:47.247730 tst handover.py: using LAC 23377 19:58:47.369072 tst handover.py: using RAC 172 19:58:47.492393 tst handover.py: using CellId 23377 19:58:47.622259 tst handover.py: using BVCI 23378 19:58:47.743403 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:47.754914 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:47.766176 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:47.778083 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:47.790979 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:47.802236 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:58:47.919483 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:58:48.040738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:48.521240 run create_hlr_db(pid=9425): Launched 19:58:48.646016 bus /sierra_2: Setting Powered False 19:58:49.710601 run create_hlr_db(pid=9425): Terminated: ok {rc=0} 19:58:50.122636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Launched 19:58:50.429675 run osmo-hlr_10.42.42.2(pid=9428): Launched 19:58:50.545693 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:51.044627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Launched 19:58:51.350375 run osmo-stp_10.42.42.5(pid=9431): Launched 19:58:51.466465 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:51.993947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Launched 19:58:52.299736 run osmo-msc_10.42.42.6(pid=9434): Launched 19:58:52.469786 run osmo-stp_10.42.42.5(pid=9431): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] 19:58:52.598320 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-09_19:58:51.293750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:52.726321 run osmo-stp_10.42.42.5(pid=9431): stderr: | [0;m[38;5;43m20221209195851463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195851463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195851464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195851464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:52.852599 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-09_19:58:51.293750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:52.974279 run osmo-stp_10.42.42.5(pid=9431): stderr: | [0;m[38;5;43m20221209195851463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195851463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195851464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195851464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195851465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:53.119566 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 19:58:53.127782 tst handover.py:18: Test FAILED (6.5 sec) 19:58:53.153492 run osmo-hlr_10.42.42.2(pid=9428): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9428)] 19:58:53.200087 run osmo-hlr_10.42.42.2(pid=9428): stdout: | (launched: 2022-12-09_19:58:50.373686) 19:58:53.248346 run osmo-hlr_10.42.42.2(pid=9428): stderr: | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195850548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195850581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195850591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195850591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195850591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:53.316075 run osmo-msc_10.42.42.6(pid=9434): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9434)] 19:58:53.362587 run osmo-msc_10.42.42.6(pid=9434): stdout: | (launched: 2022-12-09_19:58:52.243138) 19:58:53.410568 run osmo-msc_10.42.42.6(pid=9434): stderr: | [0;m[38;5;43m20221209195852511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195852512 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f121cb03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195852512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195852512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195852512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195852512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195852514 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195852514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195852515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195852515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:53.458779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminating (SIGTERM) 19:58:53.497331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminating (SIGTERM) 19:58:53.536231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Terminating (SIGTERM) 19:58:53.575928 --- ParallelTerminationStrategy: PID 9427 died... 19:58:53.594723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminated: ok {rc=0} 19:58:53.638142 --- ParallelTerminationStrategy: PID 9430 died... 19:58:53.656391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminated: ok {rc=0} 19:58:53.699960 --- ParallelTerminationStrategy: PID 9433 died... 19:58:53.718248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Terminated: ok {rc=0} 19:58:53.801394 bus /sierra_3: Setting Powered False 19:58:54.897719 bus /sierra_3: Setting Powered False 19:58:56.013987 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:58:57.270892 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:57.276620 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:58:57.337131 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:58:57.364109 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:58:57.417573 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:58:57.475460 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:58:57.501434 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:58:58.058002 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:58:58.063618 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:58.075172 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:58.124177 tst handover.py: using LAC 23378 19:58:58.253080 tst handover.py: using RAC 173 19:58:58.381379 tst handover.py: using CellId 23378 19:58:58.515173 tst handover.py: using BVCI 23379 19:58:58.635435 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:58.681234 tst handover.py: using LAC 23379 19:58:58.808526 tst handover.py: using RAC 174 19:58:58.937008 tst handover.py: using CellId 23379 19:58:59.063413 tst handover.py: using BVCI 23380 19:58:59.177435 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:59.188375 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:59.199482 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:59.211052 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:59.222513 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:59.233866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:59.352596 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:59.472282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:59.950656 run create_hlr_db(pid=9439): Launched 19:59:00.076002 bus /sierra_2: Setting Powered False 19:59:01.139885 run create_hlr_db(pid=9439): Terminated: ok {rc=0} 19:59:01.577835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9441): Launched 19:59:01.933647 run osmo-hlr_10.42.42.2(pid=9442): Launched 19:59:02.109991 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:02.648457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9444): Launched 19:59:02.976534 run osmo-stp_10.42.42.5(pid=9445): Launched 19:59:03.102723 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:03.666024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9447): Launched 19:59:03.993648 run osmo-msc_10.42.42.6(pid=9448): Launched 19:59:04.177246 run osmo-stp_10.42.42.5(pid=9445): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9445)] 19:59:04.314757 run osmo-stp_10.42.42.5(pid=9445): stdout: | (launched: 2022-12-09_19:59:02.916282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:04.452814 run osmo-stp_10.42.42.5(pid=9445): stderr: | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195903108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:04.588566 run osmo-stp_10.42.42.5(pid=9445): stdout: | (launched: 2022-12-09_19:59:02.916282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:04.718889 run osmo-stp_10.42.42.5(pid=9445): stderr: | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195903107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195903108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195903108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:04.874304 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9445): Process ended prematurely: osmo-stp_10.42.42.5(pid=9445) [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9445)] [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 19:59:04.883253 tst handover.py:18: Test FAILED (6.8 sec) 19:59:04.910960 run osmo-hlr_10.42.42.2(pid=9442): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9442)] 19:59:04.960435 run osmo-hlr_10.42.42.2(pid=9442): stdout: | (launched: 2022-12-09_19:59:01.863552) 19:59:05.011600 run osmo-hlr_10.42.42.2(pid=9442): stderr: | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195902166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195902188 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195902198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195902198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195902198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:05.083280 run osmo-msc_10.42.42.6(pid=9448): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9448)] 19:59:05.132829 run osmo-msc_10.42.42.6(pid=9448): stdout: | (launched: 2022-12-09_19:59:03.933716) 19:59:05.183909 run osmo-msc_10.42.42.6(pid=9448): stderr: | [0;m[38;5;43m20221209195904253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195904253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70daa04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195904254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195904254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195904254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195904254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195904256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195904256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195904256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195904256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:05.235323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9441): Terminating (SIGTERM) 19:59:05.276480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9444): Terminating (SIGTERM) 19:59:05.318241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9447): Terminating (SIGTERM) 19:59:05.359928 --- ParallelTerminationStrategy: PID 9441 died... 19:59:05.379676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9441): Terminated: ok {rc=0} 19:59:05.425713 --- ParallelTerminationStrategy: PID 9444 died... 19:59:05.444733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9444): Terminated: ok {rc=0} 19:59:05.491119 --- ParallelTerminationStrategy: PID 9447 died... 19:59:05.510396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9447): Terminated: ok {rc=0} 19:59:05.595921 bus /sierra_3: Setting Powered False 19:59:06.693122 bus /sierra_3: Setting Powered False 19:59:07.807170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:59:09.068839 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:09.073955 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:59:09.135783 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:59:09.162068 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:59:09.211515 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:59:09.274205 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:59:09.300277 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:59:09.851679 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:59:09.856647 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:09.867487 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:09.914306 tst handover.py: using LAC 23380 19:59:10.034613 tst handover.py: using RAC 175 19:59:10.154721 tst handover.py: using CellId 23380 19:59:10.272306 tst handover.py: using BVCI 23381 19:59:10.382407 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:10.429395 tst handover.py: using LAC 23381 19:59:10.549425 tst handover.py: using RAC 176 19:59:10.669417 tst handover.py: using CellId 23381 19:59:10.789254 tst handover.py: using BVCI 23382 19:59:10.899365 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:10.910326 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:10.921132 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:10.931869 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:10.942607 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:10.953254 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:11.069789 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:11.191770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:11.639432 run create_hlr_db(pid=9453): Launched 19:59:11.763081 bus /sierra_2: Setting Powered False 19:59:12.823804 run create_hlr_db(pid=9453): Terminated: ok {rc=0} 19:59:13.222514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Launched 19:59:13.527404 run osmo-hlr_10.42.42.2(pid=9456): Launched 19:59:13.641994 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:14.150327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Launched 19:59:14.453459 run osmo-stp_10.42.42.5(pid=9459): Launched 19:59:14.568709 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:15.092154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9461): Launched 19:59:15.395977 run osmo-msc_10.42.42.6(pid=9462): Launched 19:59:15.564845 run osmo-stp_10.42.42.5(pid=9459): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] 19:59:15.692708 run osmo-stp_10.42.42.5(pid=9459): stdout: | (launched: 2022-12-09_19:59:14.397542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:15.820102 run osmo-stp_10.42.42.5(pid=9459): stderr: | [0;m[38;5;43m20221209195914565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195914565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195914566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195914566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195914566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195914567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195914567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:15.968023 run osmo-stp_10.42.42.5(pid=9459): stdout: | (launched: 2022-12-09_19:59:14.397542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:16.101504 run osmo-stp_10.42.42.5(pid=9459): stderr: | [0;m[38;5;43m20221209195914565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195914565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195914566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195914566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195914566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195914567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195914567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:16.264312 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9459): Process ended prematurely: osmo-stp_10.42.42.5(pid=9459) [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 19:59:16.274717 tst handover.py:18: Test FAILED (6.4 sec) 19:59:16.305980 run osmo-hlr_10.42.42.2(pid=9456): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9456)] 19:59:16.359082 run osmo-hlr_10.42.42.2(pid=9456): stdout: | (launched: 2022-12-09_19:59:13.471091) 19:59:16.415599 run osmo-hlr_10.42.42.2(pid=9456): stderr: | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195913647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195913659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195913671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195913671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195913671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:16.489684 run osmo-msc_10.42.42.6(pid=9462): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9462)] 19:59:16.541996 run osmo-msc_10.42.42.6(pid=9462): stdout: | (launched: 2022-12-09_19:59:15.339691) 19:59:16.596551 run osmo-msc_10.42.42.6(pid=9462): stderr: | [0;m[38;5;43m20221209195915608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195915608 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6a3554c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195915608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195915609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195915610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195915610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195915611 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195915612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195915612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195915612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:16.651382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Terminating (SIGTERM) 19:59:16.696248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Terminating (SIGTERM) 19:59:16.742465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9461): Terminating (SIGTERM) 19:59:16.788922 --- ParallelTerminationStrategy: PID 9455 died... 19:59:16.810822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Terminated: ok {rc=0} 19:59:16.862456 --- ParallelTerminationStrategy: PID 9458 died... 19:59:16.883234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Terminated: ok {rc=0} 19:59:16.933249 --- ParallelTerminationStrategy: PID 9461 died... 19:59:16.953676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9461): Terminated: ok {rc=0} 19:59:17.047538 bus /sierra_3: Setting Powered False 19:59:18.149568 bus /sierra_3: Setting Powered False 19:59:19.264798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 19:59:20.540132 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:20.545774 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:59:20.598497 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:59:20.625520 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:59:20.679518 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:59:20.731832 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:59:20.758768 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:59:21.308058 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 19:59:21.313423 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:21.324482 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 19:59:21.378024 tst handover.py: using LAC 23382 19:59:21.519664 tst handover.py: using RAC 177 19:59:21.649225 tst handover.py: using CellId 23382 19:59:21.778192 tst handover.py: using BVCI 23383 19:59:21.896823 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 19:59:21.933356 tst handover.py: using LAC 23383 19:59:22.066896 tst handover.py: using RAC 178 19:59:22.194674 tst handover.py: using CellId 23383 19:59:22.322278 tst handover.py: using BVCI 23384 19:59:22.440877 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:22.452097 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:22.463079 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:22.474387 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:22.485653 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:22.496792 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 19:59:22.612762 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 19:59:22.729672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:23.176905 run create_hlr_db(pid=9468): Launched 19:59:23.302805 bus /sierra_2: Setting Powered False 19:59:24.363680 run create_hlr_db(pid=9468): Terminated: ok {rc=0} 19:59:24.781515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Launched 19:59:25.109576 run osmo-hlr_10.42.42.2(pid=9471): Launched 19:59:25.235607 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:25.771051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Launched 19:59:26.098453 run osmo-stp_10.42.42.5(pid=9474): Launched 19:59:26.223157 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:26.785468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9476): Launched 19:59:27.113951 run osmo-msc_10.42.42.6(pid=9477): Launched 19:59:27.296235 run osmo-stp_10.42.42.5(pid=9474): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] 19:59:27.434336 run osmo-stp_10.42.42.5(pid=9474): stdout: | (launched: 2022-12-09_19:59:26.038084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:27.573477 run osmo-stp_10.42.42.5(pid=9474): stderr: | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195926230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:27.709759 run osmo-stp_10.42.42.5(pid=9474): stdout: | (launched: 2022-12-09_19:59:26.038084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:27.840765 run osmo-stp_10.42.42.5(pid=9474): stderr: | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195926229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195926230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195926230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:27.997171 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9474): Process ended prematurely: osmo-stp_10.42.42.5(pid=9474) [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 19:59:28.006224 tst handover.py:18: Test FAILED (6.7 sec) 19:59:28.033966 run osmo-hlr_10.42.42.2(pid=9471): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9471)] 19:59:28.084242 run osmo-hlr_10.42.42.2(pid=9471): stdout: | (launched: 2022-12-09_19:59:25.049462) 19:59:28.135550 run osmo-hlr_10.42.42.2(pid=9471): stderr: | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195925248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195925261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195925269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195925270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195925270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:28.206952 run osmo-msc_10.42.42.6(pid=9477): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9477)] 19:59:28.256767 run osmo-msc_10.42.42.6(pid=9477): stdout: | (launched: 2022-12-09_19:59:27.053233) 19:59:28.307977 run osmo-msc_10.42.42.6(pid=9477): stderr: | [0;m[38;5;43m20221209195927370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195927370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b1017ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195927371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195927371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195927371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195927371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195927373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195927373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195927373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195927373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:28.359583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Terminating (SIGTERM) 19:59:28.401000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Terminating (SIGTERM) 19:59:28.442701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9476): Terminating (SIGTERM) 19:59:28.484503 --- ParallelTerminationStrategy: PID 9470 died... 19:59:28.504280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Terminated: ok {rc=0} 19:59:28.550549 --- ParallelTerminationStrategy: PID 9473 died... 19:59:28.569901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Terminated: ok {rc=0} 19:59:28.615807 --- ParallelTerminationStrategy: PID 9476 died... 19:59:28.635060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9476): Terminated: ok {rc=0} 19:59:28.722066 bus /sierra_3: Setting Powered False 19:59:29.819180 bus /sierra_3: Setting Powered False 19:59:30.957058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 19:59:32.242163 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:32.248511 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:59:32.315287 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:59:32.342633 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:59:32.395005 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:59:32.457813 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:59:32.484185 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:59:33.033751 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 19:59:33.039154 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:33.050130 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:59:33.097056 tst handover.py: using LAC 23384 19:59:33.214872 tst handover.py: using RAC 179 19:59:33.334370 tst handover.py: using CellId 23384 19:59:33.453765 tst handover.py: using BVCI 23385 19:59:33.564015 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:59:33.610700 tst handover.py: using LAC 23385 19:59:33.730279 tst handover.py: using RAC 180 19:59:33.848888 tst handover.py: using CellId 23385 19:59:33.967249 tst handover.py: using BVCI 23386 19:59:34.077680 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:34.088609 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:34.099581 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:34.110578 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:34.121686 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:34.132458 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:59:34.248525 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:59:34.362456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:34.810990 run create_hlr_db(pid=9482): Launched 19:59:34.936179 bus /sierra_2: Setting Powered False 19:59:35.997639 run create_hlr_db(pid=9482): Terminated: ok {rc=0} 19:59:36.417608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9484): Launched 19:59:36.745938 run osmo-hlr_10.42.42.2(pid=9485): Launched 19:59:36.871387 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:37.412290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9487): Launched 19:59:37.741241 run osmo-stp_10.42.42.5(pid=9488): Launched 19:59:37.866152 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:38.433649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9490): Launched 19:59:38.761888 run osmo-msc_10.42.42.6(pid=9491): Launched 19:59:38.944473 run osmo-stp_10.42.42.5(pid=9488): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9488)] 19:59:39.084261 run osmo-stp_10.42.42.5(pid=9488): stdout: | (launched: 2022-12-09_19:59:37.681051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:39.223269 run osmo-stp_10.42.42.5(pid=9488): stderr: | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195937872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:39.360651 run osmo-stp_10.42.42.5(pid=9488): stdout: | (launched: 2022-12-09_19:59:37.681051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:39.492118 run osmo-stp_10.42.42.5(pid=9488): stderr: | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195937872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195937872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195937873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:39.649308 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9488): Process ended prematurely: osmo-stp_10.42.42.5(pid=9488) [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9488)] [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 19:59:39.658575 tst handover.py:18: Test FAILED (6.6 sec) 19:59:39.686700 run osmo-hlr_10.42.42.2(pid=9485): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9485)] 19:59:39.736825 run osmo-hlr_10.42.42.2(pid=9485): stdout: | (launched: 2022-12-09_19:59:36.685868) 19:59:39.788725 run osmo-hlr_10.42.42.2(pid=9485): stderr: | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195936883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195936896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195936906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195936906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195936906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:39.860496 run osmo-msc_10.42.42.6(pid=9491): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9491)] 19:59:39.910361 run osmo-msc_10.42.42.6(pid=9491): stdout: | (launched: 2022-12-09_19:59:38.701655) 19:59:39.962484 run osmo-msc_10.42.42.6(pid=9491): stderr: | [0;m[38;5;43m20221209195939021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195939021 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb2086ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195939021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195939022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195939023 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195939024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195939024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195939024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:40.014786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9484): Terminating (SIGTERM) 19:59:40.056675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9487): Terminating (SIGTERM) 19:59:40.099081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9490): Terminating (SIGTERM) 19:59:40.141566 --- ParallelTerminationStrategy: PID 9484 died... 19:59:40.161456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9484): Terminated: ok {rc=0} 19:59:40.208331 --- ParallelTerminationStrategy: PID 9487 died... 19:59:40.227873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9487): Terminated: ok {rc=0} 19:59:40.274458 --- ParallelTerminationStrategy: PID 9490 died... 19:59:40.293969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9490): Terminated: ok {rc=0} 19:59:40.381863 bus /sierra_3: Setting Powered False 19:59:41.479753 bus /sierra_3: Setting Powered False 19:59:42.594991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 19:59:43.867635 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:43.873571 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:59:43.938224 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:59:43.965611 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:59:44.019729 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:59:44.084249 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:59:44.111801 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:59:44.661968 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 19:59:44.667997 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:44.679446 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:59:44.729074 tst handover.py: using LAC 23386 19:59:44.858896 tst handover.py: using RAC 181 19:59:44.987116 tst handover.py: using CellId 23386 19:59:45.116900 tst handover.py: using BVCI 23387 19:59:45.236128 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:59:45.284940 tst handover.py: using LAC 23387 19:59:45.414060 tst handover.py: using RAC 182 19:59:45.544261 tst handover.py: using CellId 23387 19:59:45.676426 tst handover.py: using BVCI 23388 19:59:45.797251 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:45.808615 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:45.819880 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:45.831914 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:45.852800 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:59:45.872598 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:59:46.009633 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:59:46.132694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:46.619684 run create_hlr_db(pid=9496): Launched 19:59:46.756889 bus /sierra_2: Setting Powered False 19:59:47.821739 run create_hlr_db(pid=9496): Terminated: ok {rc=0} 19:59:48.248542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Launched 19:59:48.576529 run osmo-hlr_10.42.42.2(pid=9499): Launched 19:59:48.701263 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:49.239997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Launched 19:59:49.566478 run osmo-stp_10.42.42.5(pid=9502): Launched 19:59:49.691105 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:50.255211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Launched 19:59:50.583504 run osmo-msc_10.42.42.6(pid=9505): Launched 19:59:50.765682 run osmo-stp_10.42.42.5(pid=9502): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] 19:59:50.903362 run osmo-stp_10.42.42.5(pid=9502): stdout: | (launched: 2022-12-09_19:59:49.506628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:51.041769 run osmo-stp_10.42.42.5(pid=9502): stderr: | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195949698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:51.178599 run osmo-stp_10.42.42.5(pid=9502): stdout: | (launched: 2022-12-09_19:59:49.506628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:51.309433 run osmo-stp_10.42.42.5(pid=9502): stderr: | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209195949697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209195949698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209195949698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:51.465815 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9502): Process ended prematurely: osmo-stp_10.42.42.5(pid=9502) [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 19:59:51.474747 tst handover.py:18: Test FAILED (6.8 sec) 19:59:51.502516 run osmo-hlr_10.42.42.2(pid=9499): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9499)] 19:59:51.552187 run osmo-hlr_10.42.42.2(pid=9499): stdout: | (launched: 2022-12-09_19:59:48.516441) 19:59:51.603069 run osmo-hlr_10.42.42.2(pid=9499): stderr: | [0;m[1;31m20221209195948715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209195948715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209195948715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209195948715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209195948715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209195948716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209195948731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209195948740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209195948740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209195948741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:51.674396 run osmo-msc_10.42.42.6(pid=9505): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9505)] 19:59:51.723682 run osmo-msc_10.42.42.6(pid=9505): stdout: | (launched: 2022-12-09_19:59:50.523099) 19:59:51.774477 run osmo-msc_10.42.42.6(pid=9505): stderr: | [0;m[38;5;43m20221209195950842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209195950842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e184ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209195950842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209195950842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209195950843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209195950843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209195950844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209195950845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209195950845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209195950845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:51.825899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Terminating (SIGTERM) 19:59:51.867085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Terminating (SIGTERM) 19:59:51.908480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Terminating (SIGTERM) 19:59:51.950194 --- ParallelTerminationStrategy: PID 9498 died... 19:59:51.969911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Terminated: ok {rc=0} 19:59:52.016238 --- ParallelTerminationStrategy: PID 9501 died... 19:59:52.035806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Terminated: ok {rc=0} 19:59:52.082762 --- ParallelTerminationStrategy: PID 9504 died... 19:59:52.102382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Terminated: ok {rc=0} 19:59:52.189500 bus /sierra_3: Setting Powered False 19:59:53.287800 bus /sierra_3: Setting Powered False 19:59:54.402020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:59:55.680803 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:55.686605 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:59:55.747728 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:59:55.775080 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:59:55.828044 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:59:55.889546 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:59:55.917105 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:59:56.473445 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:59:56.479117 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:56.490939 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:56.535969 tst handover.py: using LAC 23388 19:59:56.663982 tst handover.py: using RAC 183 19:59:56.790348 tst handover.py: using CellId 23388 19:59:56.917085 tst handover.py: using BVCI 23389 19:59:57.036002 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:57.084669 tst handover.py: using LAC 23389 19:59:57.215808 tst handover.py: using RAC 184 19:59:57.343169 tst handover.py: using CellId 23389 19:59:57.469617 tst handover.py: using BVCI 23390 19:59:57.583255 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:57.594674 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:57.606093 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:57.617521 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:57.628716 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:57.639934 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:57.759214 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:57.879976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:58.361511 run create_hlr_db(pid=9510): Launched 19:59:58.487013 bus /sierra_2: Setting Powered False 19:59:59.552085 run create_hlr_db(pid=9510): Terminated: ok {rc=0} 19:59:59.964143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9512): Launched 20:00:00.271628 run osmo-hlr_10.42.42.2(pid=9513): Launched 20:00:00.388547 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:00.915660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9515): Launched 20:00:01.237806 run osmo-stp_10.42.42.5(pid=9516): Launched 20:00:01.376750 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:02.137855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9521): Launched 20:00:02.459605 run osmo-msc_10.42.42.6(pid=9522): Launched 20:00:02.630738 run osmo-stp_10.42.42.5(pid=9516): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9516)] 20:00:02.759491 run osmo-stp_10.42.42.5(pid=9516): stdout: | (launched: 2022-12-09_20:00:01.177834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:02.888064 run osmo-stp_10.42.42.5(pid=9516): stderr: | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200001552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:03.014969 run osmo-stp_10.42.42.5(pid=9516): stdout: | (launched: 2022-12-09_20:00:01.177834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:03.136636 run osmo-stp_10.42.42.5(pid=9516): stderr: | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200001551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200001552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200001552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:03.282359 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9516): Process ended prematurely: osmo-stp_10.42.42.5(pid=9516) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9516)] [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 20:00:03.290884 tst handover.py:18: Test FAILED (6.8 sec) 20:00:03.317171 run osmo-hlr_10.42.42.2(pid=9513): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9513)] 20:00:03.364469 run osmo-hlr_10.42.42.2(pid=9513): stdout: | (launched: 2022-12-09_20:00:00.215218) 20:00:03.413322 run osmo-hlr_10.42.42.2(pid=9513): stderr: | [0;m[1;31m20221209200000389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200000389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200000389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200000389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200000389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200000390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200000400 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200000410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200000410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200000410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:03.481603 run osmo-msc_10.42.42.6(pid=9522): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9522)] 20:00:03.528566 run osmo-msc_10.42.42.6(pid=9522): stdout: | (launched: 2022-12-09_20:00:02.402719) 20:00:03.576816 run osmo-msc_10.42.42.6(pid=9522): stderr: | [0;m[38;5;43m20221209200002671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200002671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8784960c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200002671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200002671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200002672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200002672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200002674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200002674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200002674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200002674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:03.626096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9512): Terminating (SIGTERM) 20:00:03.665223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9515): Terminating (SIGTERM) 20:00:03.704493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9521): Terminating (SIGTERM) 20:00:03.744029 --- ParallelTerminationStrategy: PID 9512 died... 20:00:03.762965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9512): Terminated: ok {rc=0} 20:00:03.806594 --- ParallelTerminationStrategy: PID 9515 died... 20:00:03.825163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9515): Terminated: ok {rc=0} 20:00:03.868876 --- ParallelTerminationStrategy: PID 9521 died... 20:00:03.887450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9521): Terminated: ok {rc=0} 20:00:03.972510 bus /sierra_3: Setting Powered False 20:00:05.070880 bus /sierra_3: Setting Powered False 20:00:06.186836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 20:00:07.459474 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:07.465229 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:00:07.513862 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:00:07.541061 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:00:07.595056 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:00:07.643162 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:00:07.670353 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:00:08.221277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 20:00:08.226656 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:08.238118 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:08.282275 tst handover.py: using LAC 23390 20:00:08.411502 tst handover.py: using RAC 185 20:00:08.534162 tst handover.py: using CellId 23390 20:00:08.656433 tst handover.py: using BVCI 23391 20:00:08.768500 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:08.803083 tst handover.py: using LAC 23391 20:00:08.922857 tst handover.py: using RAC 186 20:00:09.042207 tst handover.py: using CellId 23391 20:00:09.161397 tst handover.py: using BVCI 23392 20:00:09.271498 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:09.282623 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:09.293537 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:09.304496 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:09.315469 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:09.326316 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:09.444021 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:09.559095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:10.007108 run create_hlr_db(pid=9527): Launched 20:00:10.131139 bus /sierra_2: Setting Powered False 20:00:11.191791 run create_hlr_db(pid=9527): Terminated: ok {rc=0} 20:00:11.591036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9529): Launched 20:00:11.895578 run osmo-hlr_10.42.42.2(pid=9530): Launched 20:00:12.011640 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:12.525724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9532): Launched 20:00:12.854589 run osmo-stp_10.42.42.5(pid=9533): Launched 20:00:12.979168 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:13.541318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9535): Launched 20:00:13.868201 run osmo-msc_10.42.42.6(pid=9536): Launched 20:00:14.049956 run osmo-stp_10.42.42.5(pid=9533): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9533)] 20:00:14.187219 run osmo-stp_10.42.42.5(pid=9533): stdout: | (launched: 2022-12-09_20:00:12.794693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:14.324581 run osmo-stp_10.42.42.5(pid=9533): stderr: | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200012985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:14.461025 run osmo-stp_10.42.42.5(pid=9533): stdout: | (launched: 2022-12-09_20:00:12.794693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:14.591461 run osmo-stp_10.42.42.5(pid=9533): stderr: | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200012984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200012985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200012985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:14.747690 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9533): Process ended prematurely: osmo-stp_10.42.42.5(pid=9533) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9533)] [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 20:00:14.756652 tst handover.py:18: Test FAILED (6.5 sec) 20:00:14.784371 run osmo-hlr_10.42.42.2(pid=9530): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9530)] 20:00:14.833846 run osmo-hlr_10.42.42.2(pid=9530): stdout: | (launched: 2022-12-09_20:00:11.839231) 20:00:14.884884 run osmo-hlr_10.42.42.2(pid=9530): stderr: | [0;m[1;31m20221209200012013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200012013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200012013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200012013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200012013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200012014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200012027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200012036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200012036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200012036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:14.956248 run osmo-msc_10.42.42.6(pid=9536): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9536)] 20:00:15.005752 run osmo-msc_10.42.42.6(pid=9536): stdout: | (launched: 2022-12-09_20:00:13.808134) 20:00:15.056863 run osmo-msc_10.42.42.6(pid=9536): stderr: | [0;m[38;5;43m20221209200014129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200014129 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca58edbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200014129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200014129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200014130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200014130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200014131 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200014132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200014132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200014132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:15.108719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9529): Terminating (SIGTERM) 20:00:15.150120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9532): Terminating (SIGTERM) 20:00:15.191375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9535): Terminating (SIGTERM) 20:00:15.232825 --- ParallelTerminationStrategy: PID 9529 died... 20:00:15.252561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9529): Terminated: ok {rc=0} 20:00:15.298503 --- ParallelTerminationStrategy: PID 9532 died... 20:00:15.318028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9532): Terminated: ok {rc=0} 20:00:15.363567 --- ParallelTerminationStrategy: PID 9535 died... 20:00:15.382714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9535): Terminated: ok {rc=0} 20:00:15.469297 bus /sierra_3: Setting Powered False 20:00:16.593471 bus /sierra_3: Setting Powered False 20:00:17.713921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 20:00:18.969506 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:18.975632 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:00:19.036217 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:00:19.063516 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:00:19.117755 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:00:19.178871 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:00:19.206189 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:00:19.756848 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 20:00:19.762577 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:19.774234 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:19.818699 tst handover.py: using LAC 23392 20:00:19.947388 tst handover.py: using RAC 187 20:00:20.073988 tst handover.py: using CellId 23392 20:00:20.203775 tst handover.py: using BVCI 23393 20:00:20.322144 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:20.371593 tst handover.py: using LAC 23393 20:00:20.500484 tst handover.py: using RAC 188 20:00:20.629843 tst handover.py: using CellId 23393 20:00:20.758482 tst handover.py: using BVCI 23394 20:00:20.878307 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:20.889998 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:20.901543 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:20.913417 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:20.925099 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:20.936732 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:21.054718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:21.174139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:21.654098 run create_hlr_db(pid=9541): Launched 20:00:21.778575 bus /sierra_2: Setting Powered False 20:00:22.843281 run create_hlr_db(pid=9541): Terminated: ok {rc=0} 20:00:23.254101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9543): Launched 20:00:23.559483 run osmo-hlr_10.42.42.2(pid=9544): Launched 20:00:23.677086 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:24.176310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9546): Launched 20:00:24.482629 run osmo-stp_10.42.42.5(pid=9547): Launched 20:00:24.599404 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:25.125274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9549): Launched 20:00:25.457376 run osmo-msc_10.42.42.6(pid=9550): Launched 20:00:25.639979 run osmo-stp_10.42.42.5(pid=9547): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9547)] 20:00:25.778279 run osmo-stp_10.42.42.5(pid=9547): stdout: | (launched: 2022-12-09_20:00:24.425315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:25.916643 run osmo-stp_10.42.42.5(pid=9547): stderr: | [0;m[38;5;43m20221209200024593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200024594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200024594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200024594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:26.053827 run osmo-stp_10.42.42.5(pid=9547): stdout: | (launched: 2022-12-09_20:00:24.425315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:26.184735 run osmo-stp_10.42.42.5(pid=9547): stderr: | [0;m[38;5;43m20221209200024593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200024594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200024594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200024594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200024595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:26.340908 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9547): Process ended prematurely: osmo-stp_10.42.42.5(pid=9547) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9547)] [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 20:00:26.349934 tst handover.py:18: Test FAILED (6.6 sec) 20:00:26.377582 run osmo-hlr_10.42.42.2(pid=9544): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9544)] 20:00:26.426984 run osmo-hlr_10.42.42.2(pid=9544): stdout: | (launched: 2022-12-09_20:00:23.503112) 20:00:26.477955 run osmo-hlr_10.42.42.2(pid=9544): stderr: | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200023681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200023693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200023703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200023704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200023704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:26.549214 run osmo-msc_10.42.42.6(pid=9550): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9550)] 20:00:26.598703 run osmo-msc_10.42.42.6(pid=9550): stdout: | (launched: 2022-12-09_20:00:25.396870) 20:00:26.649726 run osmo-msc_10.42.42.6(pid=9550): stderr: | [0;m[38;5;43m20221209200025715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200025716 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1ab56dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200025716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200025716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200025716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200025716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200025718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200025718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200025719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200025719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:26.701033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9543): Terminating (SIGTERM) 20:00:26.742288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9546): Terminating (SIGTERM) 20:00:26.783464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9549): Terminating (SIGTERM) 20:00:26.824756 --- ParallelTerminationStrategy: PID 9543 died... 20:00:26.844394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9543): Terminated: ok {rc=0} 20:00:26.890302 --- ParallelTerminationStrategy: PID 9546 died... 20:00:26.909647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9546): Terminated: ok {rc=0} 20:00:26.955351 --- ParallelTerminationStrategy: PID 9549 died... 20:00:26.974532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9549): Terminated: ok {rc=0} 20:00:27.061894 bus /sierra_3: Setting Powered False 20:00:28.159122 bus /sierra_3: Setting Powered False 20:00:29.273865 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 20:00:30.549755 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:30.555344 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:00:30.615085 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:00:30.642451 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:00:30.693811 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:00:30.753208 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:00:30.780329 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:00:31.332446 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 20:00:31.339288 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:31.351591 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:00:31.396060 tst handover.py: using LAC 23394 20:00:31.545089 tst handover.py: using RAC 189 20:00:31.668306 tst handover.py: using CellId 23394 20:00:31.809277 tst handover.py: using BVCI 23395 20:00:31.938583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:00:31.993184 tst handover.py: using LAC 23395 20:00:32.121375 tst handover.py: using RAC 190 20:00:32.248917 tst handover.py: using CellId 23395 20:00:32.367036 tst handover.py: using BVCI 23396 20:00:32.478262 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:32.489572 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:32.500464 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:32.511484 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:32.522535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:32.533605 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:00:32.652067 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:00:32.772259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:33.251897 run create_hlr_db(pid=9555): Launched 20:00:33.377328 bus /sierra_2: Setting Powered False 20:00:34.441848 run create_hlr_db(pid=9555): Terminated: ok {rc=0} 20:00:34.853833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9557): Launched 20:00:35.160628 run osmo-hlr_10.42.42.2(pid=9558): Launched 20:00:35.277142 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:35.777719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9560): Launched 20:00:36.083833 run osmo-stp_10.42.42.5(pid=9561): Launched 20:00:36.200253 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:36.725518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9563): Launched 20:00:37.031344 run osmo-msc_10.42.42.6(pid=9564): Launched 20:00:37.201519 run osmo-stp_10.42.42.5(pid=9561): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9561)] 20:00:37.329557 run osmo-stp_10.42.42.5(pid=9561): stdout: | (launched: 2022-12-09_20:00:36.027139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:37.457838 run osmo-stp_10.42.42.5(pid=9561): stderr: | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200036194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:37.584345 run osmo-stp_10.42.42.5(pid=9561): stdout: | (launched: 2022-12-09_20:00:36.027139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:37.705902 run osmo-stp_10.42.42.5(pid=9561): stderr: | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200036194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200036194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200036195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:37.851197 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9561): Process ended prematurely: osmo-stp_10.42.42.5(pid=9561) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9561)] [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 20:00:37.859604 tst handover.py:18: Test FAILED (6.5 sec) 20:00:37.885587 run osmo-hlr_10.42.42.2(pid=9558): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9558)] 20:00:37.932476 run osmo-hlr_10.42.42.2(pid=9558): stdout: | (launched: 2022-12-09_20:00:35.104011) 20:00:37.980860 run osmo-hlr_10.42.42.2(pid=9558): stderr: | [0;m[1;31m20221209200035279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200035279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200035279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200035280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200035280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200035280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200035295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200035306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200035306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200035306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:38.048484 run osmo-msc_10.42.42.6(pid=9564): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9564)] 20:00:38.095242 run osmo-msc_10.42.42.6(pid=9564): stdout: | (launched: 2022-12-09_20:00:36.974452) 20:00:38.143839 run osmo-msc_10.42.42.6(pid=9564): stderr: | [0;m[38;5;43m20221209200037243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200037243 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdf39cf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200037243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200037243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200037243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200037243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200037245 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200037245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200037246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200037246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:38.192348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9557): Terminating (SIGTERM) 20:00:38.230801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9560): Terminating (SIGTERM) 20:00:38.269553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9563): Terminating (SIGTERM) 20:00:38.309230 --- ParallelTerminationStrategy: PID 9557 died... 20:00:38.328009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9557): Terminated: ok {rc=0} 20:00:38.371751 --- ParallelTerminationStrategy: PID 9560 died... 20:00:38.390096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9560): Terminated: ok {rc=0} 20:00:38.432856 --- ParallelTerminationStrategy: PID 9563 died... 20:00:38.451202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9563): Terminated: ok {rc=0} 20:00:38.533262 bus /sierra_3: Setting Powered False 20:00:39.629430 bus /sierra_3: Setting Powered False 20:00:40.744006 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 20:00:42.011046 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:42.016697 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:00:42.069693 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:00:42.097086 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:00:42.151054 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:00:42.204619 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:00:42.231880 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:00:42.781718 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 20:00:42.787104 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:42.798490 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:42.848016 tst handover.py: using LAC 23396 20:00:42.979341 tst handover.py: using RAC 191 20:00:43.101868 tst handover.py: using CellId 23396 20:00:43.222571 tst handover.py: using BVCI 23397 20:00:43.342293 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:43.378162 tst handover.py: using LAC 23397 20:00:43.512710 tst handover.py: using RAC 192 20:00:43.640586 tst handover.py: using CellId 23397 20:00:43.766853 tst handover.py: using BVCI 23398 20:00:43.885820 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:43.897162 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:43.908256 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:43.919766 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:43.931462 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:43.942984 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:44.057994 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:44.172441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:44.622982 run create_hlr_db(pid=9569): Launched 20:00:44.748073 bus /sierra_2: Setting Powered False 20:00:45.809863 run create_hlr_db(pid=9569): Terminated: ok {rc=0} 20:00:46.256569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9571): Launched 20:00:46.586266 run osmo-hlr_10.42.42.2(pid=9572): Launched 20:00:46.839100 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:47.493652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9574): Launched 20:00:47.798523 run osmo-stp_10.42.42.5(pid=9575): Launched 20:00:47.914129 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:48.439932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9577): Launched 20:00:48.746576 run osmo-msc_10.42.42.6(pid=9578): Launched 20:00:48.918100 run osmo-stp_10.42.42.5(pid=9575): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9575)] 20:00:49.055282 run osmo-stp_10.42.42.5(pid=9575): stdout: | (launched: 2022-12-09_20:00:47.742105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:49.195334 run osmo-stp_10.42.42.5(pid=9575): stderr: | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200047911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200047911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200047911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200047912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:49.332111 run osmo-stp_10.42.42.5(pid=9575): stdout: | (launched: 2022-12-09_20:00:47.742105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:49.463775 run osmo-stp_10.42.42.5(pid=9575): stderr: | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200047910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200047911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200047911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200047911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200047912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:49.620878 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9575): Process ended prematurely: osmo-stp_10.42.42.5(pid=9575) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9575)] [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 20:00:49.630149 tst handover.py:18: Test FAILED (6.8 sec) 20:00:49.659398 run osmo-hlr_10.42.42.2(pid=9572): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9572)] 20:00:49.710362 run osmo-hlr_10.42.42.2(pid=9572): stdout: | (launched: 2022-12-09_20:00:46.526447) 20:00:49.762967 run osmo-hlr_10.42.42.2(pid=9572): stderr: | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200046841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200046859 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200046876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200046876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200046876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:49.835714 run osmo-msc_10.42.42.6(pid=9578): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9578)] 20:00:49.886307 run osmo-msc_10.42.42.6(pid=9578): stdout: | (launched: 2022-12-09_20:00:48.689666) 20:00:49.938438 run osmo-msc_10.42.42.6(pid=9578): stderr: | [0;m[38;5;43m20221209200048958 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200048958 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68fb3bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200048959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200048959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200048959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200048959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200048961 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200048961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200048961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200048961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:49.991286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9571): Terminating (SIGTERM) 20:00:50.033724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9574): Terminating (SIGTERM) 20:00:50.076440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9577): Terminating (SIGTERM) 20:00:50.119806 --- ParallelTerminationStrategy: PID 9571 died... 20:00:50.139963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9571): Terminated: ok {rc=0} 20:00:50.187525 --- ParallelTerminationStrategy: PID 9574 died... 20:00:50.206971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9574): Terminated: ok {rc=0} 20:00:50.254413 --- ParallelTerminationStrategy: PID 9577 died... 20:00:50.273912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9577): Terminated: ok {rc=0} 20:00:50.362774 bus /sierra_3: Setting Powered False 20:00:51.461786 bus /sierra_3: Setting Powered False 20:00:52.580184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 20:00:53.838244 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:53.844408 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:00:53.910342 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:00:53.937767 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:00:53.991541 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:00:54.059797 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:00:54.086876 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:00:54.640904 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 20:00:54.647340 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:54.658975 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:54.708103 tst handover.py: using LAC 23398 20:00:54.834100 tst handover.py: using RAC 193 20:00:54.960109 tst handover.py: using CellId 23398 20:00:55.086547 tst handover.py: using BVCI 23399 20:00:55.205916 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:55.253952 tst handover.py: using LAC 23399 20:00:55.382197 tst handover.py: using RAC 194 20:00:55.517829 tst handover.py: using CellId 23399 20:00:55.652248 tst handover.py: using BVCI 23400 20:00:55.771854 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:55.783258 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:55.794528 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:55.806050 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:55.817528 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:55.828858 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:55.944655 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:56.063649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:56.543803 run create_hlr_db(pid=9583): Launched 20:00:56.668943 bus /sierra_2: Setting Powered False 20:00:57.734164 run create_hlr_db(pid=9583): Terminated: ok {rc=0} 20:00:58.161624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Launched 20:00:58.490156 run osmo-hlr_10.42.42.2(pid=9586): Launched 20:00:58.615549 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:59.151070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Launched 20:00:59.479461 run osmo-stp_10.42.42.5(pid=9589): Launched 20:00:59.605014 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:00.171518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9591): Launched 20:01:00.500784 run osmo-msc_10.42.42.6(pid=9592): Launched 20:01:00.683766 run osmo-stp_10.42.42.5(pid=9589): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] 20:01:00.821986 run osmo-stp_10.42.42.5(pid=9589): stdout: | (launched: 2022-12-09_20:00:59.419359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:01.055921 run osmo-stp_10.42.42.5(pid=9589): stderr: | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200059610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:01.216829 run osmo-stp_10.42.42.5(pid=9589): stdout: | (launched: 2022-12-09_20:00:59.419359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:01.343969 run osmo-stp_10.42.42.5(pid=9589): stderr: | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200059609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200059610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200059610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:01.494397 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9589): Process ended prematurely: osmo-stp_10.42.42.5(pid=9589) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 20:01:01.503301 tst handover.py:18: Test FAILED (6.8 sec) 20:01:01.531353 run osmo-hlr_10.42.42.2(pid=9586): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9586)] 20:01:01.580640 run osmo-hlr_10.42.42.2(pid=9586): stdout: | (launched: 2022-12-09_20:00:58.429959) 20:01:01.632136 run osmo-hlr_10.42.42.2(pid=9586): stderr: | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200058629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200058641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200058650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200058650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200058650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:01.703421 run osmo-msc_10.42.42.6(pid=9592): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9592)] 20:01:01.752191 run osmo-msc_10.42.42.6(pid=9592): stdout: | (launched: 2022-12-09_20:01:00.440394) 20:01:01.802434 run osmo-msc_10.42.42.6(pid=9592): stderr: | [0;m[38;5;43m20221209200100759 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200100760 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2dedba2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200100760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200100760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200100760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200100760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200100762 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200100762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200100762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200100762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:01.854644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Terminating (SIGTERM) 20:01:01.896168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Terminating (SIGTERM) 20:01:01.938910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9591): Terminating (SIGTERM) 20:01:01.980379 --- ParallelTerminationStrategy: PID 9585 died... 20:01:02.000161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Terminated: ok {rc=0} 20:01:02.047827 --- ParallelTerminationStrategy: PID 9588 died... 20:01:02.067044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Terminated: ok {rc=0} 20:01:02.112487 --- ParallelTerminationStrategy: PID 9591 died... 20:01:02.131552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9591): Terminated: ok {rc=0} 20:01:02.217784 bus /sierra_3: Setting Powered False 20:01:03.315808 bus /sierra_3: Setting Powered False 20:01:04.433811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 20:01:05.704434 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:05.709634 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:01:05.772223 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:01:05.798233 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:01:05.850418 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:01:05.912910 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:01:05.939733 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:01:06.489612 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 20:01:06.496687 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:06.508614 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:06.560713 tst handover.py: using LAC 23400 20:01:06.690007 tst handover.py: using RAC 195 20:01:06.818240 tst handover.py: using CellId 23400 20:01:06.945828 tst handover.py: using BVCI 23401 20:01:07.066805 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:07.116133 tst handover.py: using LAC 23401 20:01:07.240641 tst handover.py: using RAC 196 20:01:07.363053 tst handover.py: using CellId 23401 20:01:07.485295 tst handover.py: using BVCI 23402 20:01:07.596746 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:07.607790 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:07.618714 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:07.630548 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:07.642069 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:07.653307 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:07.772267 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:07.889733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:08.341622 run create_hlr_db(pid=9597): Launched 20:01:08.467882 bus /sierra_2: Setting Powered False 20:01:09.529546 run create_hlr_db(pid=9597): Terminated: ok {rc=0} 20:01:09.950289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9599): Launched 20:01:10.279636 run osmo-hlr_10.42.42.2(pid=9600): Launched 20:01:10.405132 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:10.943499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9602): Launched 20:01:11.273290 run osmo-stp_10.42.42.5(pid=9603): Launched 20:01:11.398743 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:11.962615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9605): Launched 20:01:12.292259 run osmo-msc_10.42.42.6(pid=9606): Launched 20:01:12.475287 run osmo-stp_10.42.42.5(pid=9603): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9603)] 20:01:12.614076 run osmo-stp_10.42.42.5(pid=9603): stdout: | (launched: 2022-12-09_20:01:11.212580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:12.753071 run osmo-stp_10.42.42.5(pid=9603): stderr: | [0;m[38;5;43m20221209200111402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200111403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200111403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200111403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:12.889826 run osmo-stp_10.42.42.5(pid=9603): stdout: | (launched: 2022-12-09_20:01:11.212580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:13.020744 run osmo-stp_10.42.42.5(pid=9603): stderr: | [0;m[38;5;43m20221209200111402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200111403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200111403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200111403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200111404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:13.178761 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9603): Process ended prematurely: osmo-stp_10.42.42.5(pid=9603) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9603)] [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 20:01:13.187864 tst handover.py:18: Test FAILED (6.7 sec) 20:01:13.216004 run osmo-hlr_10.42.42.2(pid=9600): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9600)] 20:01:13.265705 run osmo-hlr_10.42.42.2(pid=9600): stdout: | (launched: 2022-12-09_20:01:10.219461) 20:01:13.317450 run osmo-hlr_10.42.42.2(pid=9600): stderr: | [0;m[1;31m20221209200110416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200110416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200110416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200110416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200110416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200110417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200110431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200110439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200110439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200110439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:13.389512 run osmo-msc_10.42.42.6(pid=9606): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9606)] 20:01:13.439365 run osmo-msc_10.42.42.6(pid=9606): stdout: | (launched: 2022-12-09_20:01:12.231735) 20:01:13.490762 run osmo-msc_10.42.42.6(pid=9606): stderr: | [0;m[38;5;43m20221209200112550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200112551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14e8002c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200112551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200112551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200112551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200112551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200112553 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200112553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200112553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200112554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:13.542617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9599): Terminating (SIGTERM) 20:01:13.584604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9602): Terminating (SIGTERM) 20:01:13.626561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9605): Terminating (SIGTERM) 20:01:13.668844 --- ParallelTerminationStrategy: PID 9599 died... 20:01:13.688817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9599): Terminated: ok {rc=0} 20:01:13.735765 --- ParallelTerminationStrategy: PID 9602 died... 20:01:13.755246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9602): Terminated: ok {rc=0} 20:01:13.801609 --- ParallelTerminationStrategy: PID 9605 died... 20:01:13.821162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9605): Terminated: ok {rc=0} 20:01:13.908189 bus /sierra_3: Setting Powered False 20:01:15.004848 bus /sierra_3: Setting Powered False 20:01:16.137722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 20:01:17.420667 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:17.428212 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:01:17.481824 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:01:17.509644 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:01:17.562267 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:01:17.613255 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:01:17.639341 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:01:18.190921 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 20:01:18.197925 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:18.209226 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:01:18.247373 tst handover.py: using LAC 23402 20:01:18.375270 tst handover.py: using RAC 197 20:01:18.502346 tst handover.py: using CellId 23402 20:01:18.629384 tst handover.py: using BVCI 23403 20:01:18.748058 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:01:18.795699 tst handover.py: using LAC 23403 20:01:18.922715 tst handover.py: using RAC 198 20:01:19.048793 tst handover.py: using CellId 23403 20:01:19.176343 tst handover.py: using BVCI 23404 20:01:19.295291 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:19.306644 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:19.317838 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:19.329275 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:19.340660 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:19.351986 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:01:19.469737 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:01:19.589039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:20.069594 run create_hlr_db(pid=9611): Launched 20:01:20.195459 bus /sierra_2: Setting Powered False 20:01:21.259897 run create_hlr_db(pid=9611): Terminated: ok {rc=0} 20:01:21.687501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Launched 20:01:22.015488 run osmo-hlr_10.42.42.2(pid=9614): Launched 20:01:22.141979 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:22.680821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Launched 20:01:23.008666 run osmo-stp_10.42.42.5(pid=9617): Launched 20:01:23.134569 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:23.699811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9619): Launched 20:01:24.027967 run osmo-msc_10.42.42.6(pid=9620): Launched 20:01:24.210959 run osmo-stp_10.42.42.5(pid=9617): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] 20:01:24.349253 run osmo-stp_10.42.42.5(pid=9617): stdout: | (launched: 2022-12-09_20:01:22.948481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:24.487266 run osmo-stp_10.42.42.5(pid=9617): stderr: | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200123141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:24.623728 run osmo-stp_10.42.42.5(pid=9617): stdout: | (launched: 2022-12-09_20:01:22.948481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:24.754537 run osmo-stp_10.42.42.5(pid=9617): stderr: | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200123140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200123141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200123141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:24.911014 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9617): Process ended prematurely: osmo-stp_10.42.42.5(pid=9617) [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 20:01:24.920136 tst handover.py:18: Test FAILED (6.7 sec) 20:01:24.948063 run osmo-hlr_10.42.42.2(pid=9614): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9614)] 20:01:24.997866 run osmo-hlr_10.42.42.2(pid=9614): stdout: | (launched: 2022-12-09_20:01:21.955318) 20:01:25.049234 run osmo-hlr_10.42.42.2(pid=9614): stderr: | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200122152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200122168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200122176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200122177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200122177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:25.120601 run osmo-msc_10.42.42.6(pid=9620): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9620)] 20:01:25.170513 run osmo-msc_10.42.42.6(pid=9620): stdout: | (launched: 2022-12-09_20:01:23.967620) 20:01:25.222126 run osmo-msc_10.42.42.6(pid=9620): stderr: | [0;m[38;5;43m20221209200124286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200124286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f8d7cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200124286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200124286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200124286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200124286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200124288 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200124288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200124289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200124289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:25.273700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Terminating (SIGTERM) 20:01:25.315126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Terminating (SIGTERM) 20:01:25.356792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9619): Terminating (SIGTERM) 20:01:25.399237 --- ParallelTerminationStrategy: PID 9613 died... 20:01:25.419125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Terminated: ok {rc=0} 20:01:25.465548 --- ParallelTerminationStrategy: PID 9616 died... 20:01:25.484908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Terminated: ok {rc=0} 20:01:25.531040 --- ParallelTerminationStrategy: PID 9619 died... 20:01:25.550739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9619): Terminated: ok {rc=0} 20:01:25.638056 bus /sierra_3: Setting Powered False 20:01:26.735096 bus /sierra_3: Setting Powered False 20:01:27.850240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 20:01:29.104258 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:29.109676 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:01:29.158915 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:01:29.184886 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:01:29.236316 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:01:29.285773 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:01:29.311869 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:01:29.863034 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 20:01:29.869872 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:29.881840 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:29.917924 tst handover.py: using LAC 23404 20:01:30.046281 tst handover.py: using RAC 199 20:01:30.177373 tst handover.py: using CellId 23404 20:01:30.299380 tst handover.py: using BVCI 23405 20:01:30.411344 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:30.458565 tst handover.py: using LAC 23405 20:01:30.580668 tst handover.py: using RAC 200 20:01:30.701807 tst handover.py: using CellId 23405 20:01:30.821311 tst handover.py: using BVCI 23406 20:01:30.979457 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:30.990708 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:31.003563 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:31.014719 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:31.025953 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:31.036878 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:31.162128 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:31.277172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:31.737615 run create_hlr_db(pid=9625): Launched 20:01:31.900436 bus /sierra_2: Setting Powered False 20:01:32.961590 run create_hlr_db(pid=9625): Terminated: ok {rc=0} 20:01:33.362812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Launched 20:01:33.668328 run osmo-hlr_10.42.42.2(pid=9628): Launched 20:01:33.783830 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:34.282461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Launched 20:01:34.587220 run osmo-stp_10.42.42.5(pid=9631): Launched 20:01:34.703274 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:35.228590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9633): Launched 20:01:35.535192 run osmo-msc_10.42.42.6(pid=9634): Launched 20:01:35.705223 run osmo-stp_10.42.42.5(pid=9631): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] 20:01:35.833603 run osmo-stp_10.42.42.5(pid=9631): stdout: | (launched: 2022-12-09_20:01:34.530593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:35.961842 run osmo-stp_10.42.42.5(pid=9631): stderr: | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200134698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:36.088578 run osmo-stp_10.42.42.5(pid=9631): stdout: | (launched: 2022-12-09_20:01:34.530593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:36.210299 run osmo-stp_10.42.42.5(pid=9631): stderr: | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200134698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200134698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200134699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:36.355733 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9631): Process ended prematurely: osmo-stp_10.42.42.5(pid=9631) [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 20:01:36.363997 tst handover.py:18: Test FAILED (6.5 sec) 20:01:36.389778 run osmo-hlr_10.42.42.2(pid=9628): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9628)] 20:01:36.436618 run osmo-hlr_10.42.42.2(pid=9628): stdout: | (launched: 2022-12-09_20:01:33.611653) 20:01:36.485118 run osmo-hlr_10.42.42.2(pid=9628): stderr: | [0;m[1;31m20221209200133786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200133786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200133786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200133786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200133786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200133787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200133799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200133808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200133808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200133808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:36.552902 run osmo-msc_10.42.42.6(pid=9634): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9634)] 20:01:36.599831 run osmo-msc_10.42.42.6(pid=9634): stdout: | (launched: 2022-12-09_20:01:35.478464) 20:01:36.647890 run osmo-msc_10.42.42.6(pid=9634): stderr: | [0;m[38;5;43m20221209200135747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200135747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8c84d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200135747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200135747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200135747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200135748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200135749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200135750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200135750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200135750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:36.696619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Terminating (SIGTERM) 20:01:36.735493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Terminating (SIGTERM) 20:01:36.774430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9633): Terminating (SIGTERM) 20:01:36.814854 --- ParallelTerminationStrategy: PID 9627 died... 20:01:36.833660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Terminated: ok {rc=0} 20:01:36.877363 --- ParallelTerminationStrategy: PID 9630 died... 20:01:36.895803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Terminated: ok {rc=0} 20:01:36.939691 --- ParallelTerminationStrategy: PID 9633 died... 20:01:36.958257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9633): Terminated: ok {rc=0} 20:01:37.040629 bus /sierra_3: Setting Powered False 20:01:38.138876 bus /sierra_3: Setting Powered False 20:01:39.255470 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2363 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 20:01:40.509590 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:40.514692 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:01:40.575809 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:01:40.602033 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:01:40.654299 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:01:40.716274 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:01:40.742190 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:01:41.294745 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2363 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 20:01:41.300571 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:41.312067 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:41.362384 tst handover.py: using LAC 23406 20:01:41.493038 tst handover.py: using RAC 201 20:01:41.622083 tst handover.py: using CellId 23406 20:01:41.743383 tst handover.py: using BVCI 23407 20:01:41.855561 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:41.902495 tst handover.py: using LAC 23407 20:01:42.024223 tst handover.py: using RAC 202 20:01:42.145112 tst handover.py: using CellId 23407 20:01:42.264642 tst handover.py: using BVCI 23408 20:01:42.374872 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:42.385636 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:42.396124 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:42.406794 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:42.417476 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:42.427912 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:42.544084 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:42.661961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:43.112056 run create_hlr_db(pid=9639): Launched 20:01:43.237435 bus /sierra_2: Setting Powered False 20:01:44.297998 run create_hlr_db(pid=9639): Terminated: ok {rc=0} 20:01:44.698968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Launched 20:01:45.005532 run osmo-hlr_10.42.42.2(pid=9642): Launched 20:01:45.122373 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:45.624304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Launched 20:01:45.934198 run osmo-stp_10.42.42.5(pid=9645): Launched 20:01:46.344109 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:46.977801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9647): Launched 20:01:47.305823 run osmo-msc_10.42.42.6(pid=9648): Launched 20:01:47.478374 run osmo-stp_10.42.42.5(pid=9645): ERR: Terminated: ERROR {rc=1} [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] 20:01:47.609360 run osmo-stp_10.42.42.5(pid=9645): stdout: | (launched: 2022-12-09_20:01:45.874732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:47.737953 run osmo-stp_10.42.42.5(pid=9645): stderr: | [0;m[38;5;43m20221209200146106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200146106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200146107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200146107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200146107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200146108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200146108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:47.864514 run osmo-stp_10.42.42.5(pid=9645): stdout: | (launched: 2022-12-09_20:01:45.874732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:47.986253 run osmo-stp_10.42.42.5(pid=9645): stderr: | [0;m[38;5;43m20221209200146106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209200146106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209200146107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209200146107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200146107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200146108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200146108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:48.131815 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9645): Process ended prematurely: osmo-stp_10.42.42.5(pid=9645) [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 20:01:48.140070 tst handover.py:18: Test FAILED (6.8 sec) 20:01:48.166115 run osmo-hlr_10.42.42.2(pid=9642): ERR: Terminated: ERROR {rc=237} [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9642)] 20:01:48.213484 run osmo-hlr_10.42.42.2(pid=9642): stdout: | (launched: 2022-12-09_20:01:44.949121) 20:01:48.262362 run osmo-hlr_10.42.42.2(pid=9642): stderr: | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209200145123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209200145135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209200145143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200145144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200145144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:48.330729 run osmo-msc_10.42.42.6(pid=9648): ERR: Terminated: ERROR {rc=2} [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9648)] 20:01:48.378065 run osmo-msc_10.42.42.6(pid=9648): stdout: | (launched: 2022-12-09_20:01:47.245367) 20:01:48.426839 run osmo-msc_10.42.42.6(pid=9648): stderr: | [0;m[38;5;43m20221209200147523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209200147523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fccda322c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209200147523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209200147523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209200147523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209200147524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209200147525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209200147526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200147526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200147526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:48.476316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Terminating (SIGTERM) 20:01:48.515650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Terminating (SIGTERM) 20:01:48.555077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9647): Terminating (SIGTERM) 20:01:48.594980 --- ParallelTerminationStrategy: PID 9641 died... 20:01:48.614060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Terminated: ok {rc=0} 20:01:48.658035 --- ParallelTerminationStrategy: PID 9644 died... 20:01:48.676448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Terminated: ok {rc=0} 20:01:48.720242 --- ParallelTerminationStrategy: PID 9647 died... 20:01:48.738796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9647): Terminated: ok {rc=0} 20:01:48.824161 bus /sierra_3: Setting Powered False 20:01:49.923829 bus /sierra_3: Setting Powered False 20:01:51.038319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2363 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 20:01:52.311407 tst trial-2363: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363/run.2022-12-09_18-37-22/trial-2363.xml -------------------------------------------------------------------------------------------- trial-2363 FAIL -------------------------------------------------------------------------------------------- 20:01:54.240310 tst trial-2363: trial-2363: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=2033): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2033) [trial-2363↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2033)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=2043): Process ended prematurely: osmo-stp_10.42.42.5(pid=2043) [trial-2363↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2052) [trial-2363↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2052)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=2066): Process ended prematurely: osmo-stp_10.42.42.5(pid=2066) [trial-2363↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2080): Process ended prematurely: osmo-stp_10.42.42.5(pid=2080) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2080)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2091): Process ended prematurely: osmo-stp_10.42.42.5(pid=2091) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2091)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2105): Process ended prematurely: osmo-stp_10.42.42.5(pid=2105) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2117): Process ended prematurely: osmo-stp_10.42.42.5(pid=2117) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2117)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2131): Process ended prematurely: osmo-stp_10.42.42.5(pid=2131) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2131)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2142): Process ended prematurely: osmo-stp_10.42.42.5(pid=2142) [trial-2363↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2142)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2156): Process ended prematurely: osmo-stp_10.42.42.5(pid=2156) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2156)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2167): Process ended prematurely: osmo-stp_10.42.42.5(pid=2167) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2167)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2181): Process ended prematurely: osmo-stp_10.42.42.5(pid=2181) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2192): Process ended prematurely: osmo-stp_10.42.42.5(pid=2192) [trial-2363↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2209): Process ended prematurely: osmo-stp_10.42.42.5(pid=2209) [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2209)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2220): Process ended prematurely: osmo-stp_10.42.42.5(pid=2220) [trial-2363↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2234): Process ended prematurely: osmo-stp_10.42.42.5(pid=2234) [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2234)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2245): Process ended prematurely: osmo-stp_10.42.42.5(pid=2245) [trial-2363↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2245)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2259): Process ended prematurely: osmo-stp_10.42.42.5(pid=2259) [trial-2363↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2259)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2270): Process ended prematurely: osmo-stp_10.42.42.5(pid=2270) [trial-2363↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2270)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=2288): Process ended prematurely: osmo-stp_10.42.42.5(pid=2288) [trial-2363↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2288)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=2300): Process ended prematurely: osmo-stp_10.42.42.5(pid=2300) [trial-2363↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2300)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2318): Process ended prematurely: osmo-stp_10.42.42.5(pid=2318) [trial-2363↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2328): Process ended prematurely: osmo-stp_10.42.42.5(pid=2328) [trial-2363↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2363↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=2355): Process ended prematurely: osmo-stp_10.42.42.5(pid=2355) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=2367): Process ended prematurely: osmo-stp_10.42.42.5(pid=2367) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2367)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2385): Process ended prematurely: osmo-stp_10.42.42.5(pid=2385) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2385)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2395): Process ended prematurely: osmo-stp_10.42.42.5(pid=2395) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2405): Process ended prematurely: osmo-stp_10.42.42.5(pid=2405) [trial-2363↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2405)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=2425): Process ended prematurely: osmo-stp_10.42.42.5(pid=2425) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=2439): Process ended prematurely: osmo-stp_10.42.42.5(pid=2439) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2439)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=2457): Process ended prematurely: osmo-stp_10.42.42.5(pid=2457) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2457)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2467): Process ended prematurely: osmo-stp_10.42.42.5(pid=2467) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2478): Process ended prematurely: osmo-stp_10.42.42.5(pid=2478) [trial-2363↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=2496): Process ended prematurely: osmo-stp_10.42.42.5(pid=2496) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2496)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=2508): Process ended prematurely: osmo-stp_10.42.42.5(pid=2508) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2508)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2526): Process ended prematurely: osmo-stp_10.42.42.5(pid=2526) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2526)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2546): Process ended prematurely: osmo-stp_10.42.42.5(pid=2546) [trial-2363↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2546)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2559): Process ended prematurely: osmo-stp_10.42.42.5(pid=2559) [trial-2363↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2559)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2572): Process ended prematurely: osmo-stp_10.42.42.5(pid=2572) [trial-2363↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2572)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2581): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2581) [trial-2363↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2581)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=2592): Process ended prematurely: osmo-stp_10.42.42.5(pid=2592) [trial-2363↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2592)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2601): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2601) [trial-2363↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2601)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=2612): Process ended prematurely: osmo-stp_10.42.42.5(pid=2612) [trial-2363↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2612)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2626): Process ended prematurely: osmo-stp_10.42.42.5(pid=2626) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2626)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2637): Process ended prematurely: osmo-stp_10.42.42.5(pid=2637) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2637)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2651): Process ended prematurely: osmo-stp_10.42.42.5(pid=2651) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2651)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2662): Process ended prematurely: osmo-stp_10.42.42.5(pid=2662) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2662)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2676): Process ended prematurely: osmo-stp_10.42.42.5(pid=2676) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2676)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2687): Process ended prematurely: osmo-stp_10.42.42.5(pid=2687) [trial-2363↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2687)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2701): Process ended prematurely: osmo-stp_10.42.42.5(pid=2701) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2712): Process ended prematurely: osmo-stp_10.42.42.5(pid=2712) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2726): Process ended prematurely: osmo-stp_10.42.42.5(pid=2726) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2726)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2737): Process ended prematurely: osmo-stp_10.42.42.5(pid=2737) [trial-2363↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2751): Process ended prematurely: osmo-stp_10.42.42.5(pid=2751) [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2751)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2762): Process ended prematurely: osmo-stp_10.42.42.5(pid=2762) [trial-2363↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2762)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2781): Process ended prematurely: osmo-stp_10.42.42.5(pid=2781) [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2792): Process ended prematurely: osmo-stp_10.42.42.5(pid=2792) [trial-2363↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2792)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2363↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2817): Process ended prematurely: osmo-stp_10.42.42.5(pid=2817) [trial-2363↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=2835): Process ended prematurely: osmo-stp_10.42.42.5(pid=2835) [trial-2363↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2835)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2848): Process ended prematurely: osmo-stp_10.42.42.5(pid=2848) [trial-2363↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2866): Process ended prematurely: osmo-stp_10.42.42.5(pid=2866) [trial-2363↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2866)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2363↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2886): Process ended prematurely: osmo-stp_10.42.42.5(pid=2886) [trial-2363↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2886)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=2903): Process ended prematurely: osmo-stp_10.42.42.5(pid=2903) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=2915): Process ended prematurely: osmo-stp_10.42.42.5(pid=2915) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2915)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2933): Process ended prematurely: osmo-stp_10.42.42.5(pid=2933) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2943): Process ended prematurely: osmo-stp_10.42.42.5(pid=2943) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2943)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2953): Process ended prematurely: osmo-stp_10.42.42.5(pid=2953) [trial-2363↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2953)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=2970): Process ended prematurely: osmo-stp_10.42.42.5(pid=2970) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2970)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=3253): Process ended prematurely: osmo-stp_10.42.42.5(pid=3253) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=3271): Process ended prematurely: osmo-stp_10.42.42.5(pid=3271) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3271)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3281): Process ended prematurely: osmo-stp_10.42.42.5(pid=3281) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3281)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3292): Process ended prematurely: osmo-stp_10.42.42.5(pid=3292) [trial-2363↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=3310): Process ended prematurely: osmo-stp_10.42.42.5(pid=3310) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3310)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3322): Process ended prematurely: osmo-stp_10.42.42.5(pid=3322) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3322)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=3340): Process ended prematurely: osmo-stp_10.42.42.5(pid=3340) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3340)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3350): Process ended prematurely: osmo-stp_10.42.42.5(pid=3350) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3360): Process ended prematurely: osmo-stp_10.42.42.5(pid=3360) [trial-2363↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3360)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3373): Process ended prematurely: osmo-stp_10.42.42.5(pid=3373) [trial-2363↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3390): Process ended prematurely: osmo-stp_10.42.42.5(pid=3390) [trial-2363↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=3398): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3398) [trial-2363↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3398)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3409): Process ended prematurely: osmo-stp_10.42.42.5(pid=3409) [trial-2363↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3409)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=3418): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3418) [trial-2363↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3418)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3428): Process ended prematurely: osmo-stp_10.42.42.5(pid=3428) [trial-2363↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3442): Process ended prematurely: osmo-stp_10.42.42.5(pid=3442) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3442)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3453): Process ended prematurely: osmo-stp_10.42.42.5(pid=3453) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3468): Process ended prematurely: osmo-stp_10.42.42.5(pid=3468) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3468)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3479): Process ended prematurely: osmo-stp_10.42.42.5(pid=3479) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3493): Process ended prematurely: osmo-stp_10.42.42.5(pid=3493) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3493)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3504): Process ended prematurely: osmo-stp_10.42.42.5(pid=3504) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3504)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3518): Process ended prematurely: osmo-stp_10.42.42.5(pid=3518) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3518)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3543): Process ended prematurely: osmo-stp_10.42.42.5(pid=3543) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3543)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3554): Process ended prematurely: osmo-stp_10.42.42.5(pid=3554) [trial-2363↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3554)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3572): Process ended prematurely: osmo-stp_10.42.42.5(pid=3572) [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3572)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3584): Process ended prematurely: osmo-stp_10.42.42.5(pid=3584) [trial-2363↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3584)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3598): Process ended prematurely: osmo-stp_10.42.42.5(pid=3598) [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2363↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3623): Process ended prematurely: osmo-stp_10.42.42.5(pid=3623) [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3634): Process ended prematurely: osmo-stp_10.42.42.5(pid=3634) [trial-2363↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3648): Process ended prematurely: osmo-stp_10.42.42.5(pid=3648) [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3648)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3659): Process ended prematurely: osmo-stp_10.42.42.5(pid=3659) [trial-2363↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3659)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3673): Process ended prematurely: osmo-stp_10.42.42.5(pid=3673) [trial-2363↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3673)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3684): Process ended prematurely: osmo-stp_10.42.42.5(pid=3684) [trial-2363↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=3702): Process ended prematurely: osmo-stp_10.42.42.5(pid=3702) [trial-2363↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=3714): Process ended prematurely: osmo-stp_10.42.42.5(pid=3714) [trial-2363↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3714)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=3732): Process ended prematurely: osmo-stp_10.42.42.5(pid=3732) [trial-2363↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3732)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3745): Process ended prematurely: osmo-stp_10.42.42.5(pid=3745) [trial-2363↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3745)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3755): Process ended prematurely: osmo-stp_10.42.42.5(pid=3755) [trial-2363↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3755)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3773): Process ended prematurely: osmo-stp_10.42.42.5(pid=3773) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3785): Process ended prematurely: osmo-stp_10.42.42.5(pid=3785) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=3803): Process ended prematurely: osmo-stp_10.42.42.5(pid=3803) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3813): Process ended prematurely: osmo-stp_10.42.42.5(pid=3813) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3813)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3823): Process ended prematurely: osmo-stp_10.42.42.5(pid=3823) [trial-2363↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3823)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3842): Process ended prematurely: osmo-stp_10.42.42.5(pid=3842) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=3854): Process ended prematurely: osmo-stp_10.42.42.5(pid=3854) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3854)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3872): Process ended prematurely: osmo-stp_10.42.42.5(pid=3872) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3892): Process ended prematurely: osmo-stp_10.42.42.5(pid=3892) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3912): Process ended prematurely: osmo-stp_10.42.42.5(pid=3912) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3912)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=3924): Process ended prematurely: osmo-stp_10.42.42.5(pid=3924) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=3942): Process ended prematurely: osmo-stp_10.42.42.5(pid=3942) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3953): Process ended prematurely: osmo-stp_10.42.42.5(pid=3953) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3963): Process ended prematurely: osmo-stp_10.42.42.5(pid=3963) [trial-2363↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3963)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=3980): Process ended prematurely: osmo-stp_10.42.42.5(pid=3980) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=3992): Process ended prematurely: osmo-stp_10.42.42.5(pid=3992) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=4010): Process ended prematurely: osmo-stp_10.42.42.5(pid=4010) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4010)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4022): Process ended prematurely: osmo-stp_10.42.42.5(pid=4022) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4032): Process ended prematurely: osmo-stp_10.42.42.5(pid=4032) [trial-2363↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4032)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4046): Process ended prematurely: osmo-stp_10.42.42.5(pid=4046) [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4059): Process ended prematurely: osmo-stp_10.42.42.5(pid=4059) [trial-2363↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2363↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4080): Process ended prematurely: osmo-stp_10.42.42.5(pid=4080) [trial-2363↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4080)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4090) [trial-2363↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4090)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4100): Process ended prematurely: osmo-stp_10.42.42.5(pid=4100) [trial-2363↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4100)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4114): Process ended prematurely: osmo-stp_10.42.42.5(pid=4114) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4114)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4125): Process ended prematurely: osmo-stp_10.42.42.5(pid=4125) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4125)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4139): Process ended prematurely: osmo-stp_10.42.42.5(pid=4139) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4139)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4150): Process ended prematurely: osmo-stp_10.42.42.5(pid=4150) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4150)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4164): Process ended prematurely: osmo-stp_10.42.42.5(pid=4164) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4175): Process ended prematurely: osmo-stp_10.42.42.5(pid=4175) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4191): Process ended prematurely: osmo-stp_10.42.42.5(pid=4191) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4191)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4202): Process ended prematurely: osmo-stp_10.42.42.5(pid=4202) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4216): Process ended prematurely: osmo-stp_10.42.42.5(pid=4216) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4216)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4227): Process ended prematurely: osmo-stp_10.42.42.5(pid=4227) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4241): Process ended prematurely: osmo-stp_10.42.42.5(pid=4241) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4241)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4252): Process ended prematurely: osmo-stp_10.42.42.5(pid=4252) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4252)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4266): Process ended prematurely: osmo-stp_10.42.42.5(pid=4266) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4266)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4277): Process ended prematurely: osmo-stp_10.42.42.5(pid=4277) [trial-2363↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4369): Process ended prematurely: osmo-stp_10.42.42.5(pid=4369) [trial-2363↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4369)] FAIL: emergency_preemptive_call.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4573): Process ended prematurely: osmo-stp_10.42.42.5(pid=4573) [trial-2363↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4573)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2363↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2363↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=4624): Process ended prematurely: osmo-stp_10.42.42.5(pid=4624) [trial-2363↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4624)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4634): Process ended prematurely: osmo-stp_10.42.42.5(pid=4634) [trial-2363↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4644): Process ended prematurely: osmo-stp_10.42.42.5(pid=4644) [trial-2363↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4644)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4662): Process ended prematurely: osmo-stp_10.42.42.5(pid=4662) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4662)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4674): Process ended prematurely: osmo-stp_10.42.42.5(pid=4674) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4674)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=4692): Process ended prematurely: osmo-stp_10.42.42.5(pid=4692) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4692)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5064): Process ended prematurely: osmo-stp_10.42.42.5(pid=5064) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5064)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=5249): Process ended prematurely: osmo-stp_10.42.42.5(pid=5249) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5249)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=5268): Process ended prematurely: osmo-stp_10.42.42.5(pid=5268) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5268)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=5280): Process ended prematurely: osmo-stp_10.42.42.5(pid=5280) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5280)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5298): Process ended prematurely: osmo-stp_10.42.42.5(pid=5298) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5298)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5308): Process ended prematurely: osmo-stp_10.42.42.5(pid=5308) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5308)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5319): Process ended prematurely: osmo-stp_10.42.42.5(pid=5319) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5319)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5336): Process ended prematurely: osmo-stp_10.42.42.5(pid=5336) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5336)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5376): Process ended prematurely: osmo-stp_10.42.42.5(pid=5376) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5376)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5386): Process ended prematurely: osmo-stp_10.42.42.5(pid=5386) [trial-2363↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5399): Process ended prematurely: osmo-stp_10.42.42.5(pid=5399) [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5399)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=5415): Process ended prematurely: osmo-stp_10.42.42.5(pid=5415) [trial-2363↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5415)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=5423): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5423) [trial-2363↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5423)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5433): Process ended prematurely: osmo-stp_10.42.42.5(pid=5433) [trial-2363↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5433)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5442): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5442) [trial-2363↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5442)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=5452): Process ended prematurely: osmo-stp_10.42.42.5(pid=5452) [trial-2363↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5452)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5467): Process ended prematurely: osmo-stp_10.42.42.5(pid=5467) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5467)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5478): Process ended prematurely: osmo-stp_10.42.42.5(pid=5478) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5478)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5492): Process ended prematurely: osmo-stp_10.42.42.5(pid=5492) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5492)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5503): Process ended prematurely: osmo-stp_10.42.42.5(pid=5503) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5503)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5518): Process ended prematurely: osmo-stp_10.42.42.5(pid=5518) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5518)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5529): Process ended prematurely: osmo-stp_10.42.42.5(pid=5529) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5529)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5543): Process ended prematurely: osmo-stp_10.42.42.5(pid=5543) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5554): Process ended prematurely: osmo-stp_10.42.42.5(pid=5554) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5554)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5582): Process ended prematurely: osmo-stp_10.42.42.5(pid=5582) [trial-2363↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5582)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5596): Process ended prematurely: osmo-stp_10.42.42.5(pid=5596) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5596)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5607): Process ended prematurely: osmo-stp_10.42.42.5(pid=5607) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5607)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5621): Process ended prematurely: osmo-stp_10.42.42.5(pid=5621) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5621)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2363↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5646): Process ended prematurely: osmo-stp_10.42.42.5(pid=5646) [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5646)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5657): Process ended prematurely: osmo-stp_10.42.42.5(pid=5657) [trial-2363↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5671): Process ended prematurely: osmo-stp_10.42.42.5(pid=5671) [trial-2363↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5671)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2363↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5700): Process ended prematurely: osmo-stp_10.42.42.5(pid=5700) [trial-2363↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5700)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5715): Process ended prematurely: osmo-stp_10.42.42.5(pid=5715) [trial-2363↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5733): Process ended prematurely: osmo-stp_10.42.42.5(pid=5733) [trial-2363↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2363↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5753): Process ended prematurely: osmo-stp_10.42.42.5(pid=5753) [trial-2363↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=5772): Process ended prematurely: osmo-stp_10.42.42.5(pid=5772) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5772)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5784): Process ended prematurely: osmo-stp_10.42.42.5(pid=5784) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5784)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5802): Process ended prematurely: osmo-stp_10.42.42.5(pid=5802) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5802)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5812): Process ended prematurely: osmo-stp_10.42.42.5(pid=5812) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5812)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2363↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5840): Process ended prematurely: osmo-stp_10.42.42.5(pid=5840) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=5870): Process ended prematurely: osmo-stp_10.42.42.5(pid=5870) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5870)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5881): Process ended prematurely: osmo-stp_10.42.42.5(pid=5881) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5881)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5891): Process ended prematurely: osmo-stp_10.42.42.5(pid=5891) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5891)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5908): Process ended prematurely: osmo-stp_10.42.42.5(pid=5908) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=5925): Process ended prematurely: osmo-stp_10.42.42.5(pid=5925) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5925)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=5943): Process ended prematurely: osmo-stp_10.42.42.5(pid=5943) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5953): Process ended prematurely: osmo-stp_10.42.42.5(pid=5953) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5963): Process ended prematurely: osmo-stp_10.42.42.5(pid=5963) [trial-2363↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5963)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5980): Process ended prematurely: osmo-stp_10.42.42.5(pid=5980) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5980)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5992): Process ended prematurely: osmo-stp_10.42.42.5(pid=5992) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5992)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6010): Process ended prematurely: osmo-stp_10.42.42.5(pid=6010) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6020): Process ended prematurely: osmo-stp_10.42.42.5(pid=6020) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6020)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6030): Process ended prematurely: osmo-stp_10.42.42.5(pid=6030) [trial-2363↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6030)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6057): Process ended prematurely: osmo-stp_10.42.42.5(pid=6057) [trial-2363↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6057)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6067) [trial-2363↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6067)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2363↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6087): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6087) [trial-2363↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6087)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6098): Process ended prematurely: osmo-stp_10.42.42.5(pid=6098) [trial-2363↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6098)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6112): Process ended prematurely: osmo-stp_10.42.42.5(pid=6112) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6112)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=6408): Process ended prematurely: osmo-stp_10.42.42.5(pid=6408) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6408)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6419): Process ended prematurely: osmo-stp_10.42.42.5(pid=6419) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6434): Process ended prematurely: osmo-stp_10.42.42.5(pid=6434) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6434)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6445): Process ended prematurely: osmo-stp_10.42.42.5(pid=6445) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6462): Process ended prematurely: osmo-stp_10.42.42.5(pid=6462) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6462)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6473): Process ended prematurely: osmo-stp_10.42.42.5(pid=6473) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6473)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6487): Process ended prematurely: osmo-stp_10.42.42.5(pid=6487) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6487)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6498): Process ended prematurely: osmo-stp_10.42.42.5(pid=6498) [trial-2363↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6498)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6512): Process ended prematurely: osmo-stp_10.42.42.5(pid=6512) [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6512)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2363↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6538): Process ended prematurely: osmo-stp_10.42.42.5(pid=6538) [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=6552): Process ended prematurely: osmo-stp_10.42.42.5(pid=6552) [trial-2363↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6552)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6566): Process ended prematurely: osmo-stp_10.42.42.5(pid=6566) [trial-2363↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6577): Process ended prematurely: osmo-stp_10.42.42.5(pid=6577) [trial-2363↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6577)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=6597): Process ended prematurely: osmo-stp_10.42.42.5(pid=6597) [trial-2363↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6609): Process ended prematurely: osmo-stp_10.42.42.5(pid=6609) [trial-2363↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=6627): Process ended prematurely: osmo-stp_10.42.42.5(pid=6627) [trial-2363↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6627)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6637): Process ended prematurely: osmo-stp_10.42.42.5(pid=6637) [trial-2363↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6637)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6647): Process ended prematurely: osmo-stp_10.42.42.5(pid=6647) [trial-2363↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6664): Process ended prematurely: osmo-stp_10.42.42.5(pid=6664) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6664)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=6694): Process ended prematurely: osmo-stp_10.42.42.5(pid=6694) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6694)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6704): Process ended prematurely: osmo-stp_10.42.42.5(pid=6704) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6704)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6714): Process ended prematurely: osmo-stp_10.42.42.5(pid=6714) [trial-2363↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6714)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=6732): Process ended prematurely: osmo-stp_10.42.42.5(pid=6732) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6732)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6744): Process ended prematurely: osmo-stp_10.42.42.5(pid=6744) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6744)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=6762): Process ended prematurely: osmo-stp_10.42.42.5(pid=6762) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6762)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6774): Process ended prematurely: osmo-stp_10.42.42.5(pid=6774) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6784): Process ended prematurely: osmo-stp_10.42.42.5(pid=6784) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6801): Process ended prematurely: osmo-stp_10.42.42.5(pid=6801) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6801)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6813): Process ended prematurely: osmo-stp_10.42.42.5(pid=6813) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6813)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=6831): Process ended prematurely: osmo-stp_10.42.42.5(pid=6831) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6831)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6841): Process ended prematurely: osmo-stp_10.42.42.5(pid=6841) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6841)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6852): Process ended prematurely: osmo-stp_10.42.42.5(pid=6852) [trial-2363↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6866): Process ended prematurely: osmo-stp_10.42.42.5(pid=6866) [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6879): Process ended prematurely: osmo-stp_10.42.42.5(pid=6879) [trial-2363↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=6890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6890) [trial-2363↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6890)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6900): Process ended prematurely: osmo-stp_10.42.42.5(pid=6900) [trial-2363↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=6909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6909) [trial-2363↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6909)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6920): Process ended prematurely: osmo-stp_10.42.42.5(pid=6920) [trial-2363↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6942): Process ended prematurely: osmo-stp_10.42.42.5(pid=6942) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6953): Process ended prematurely: osmo-stp_10.42.42.5(pid=6953) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7003): Process ended prematurely: osmo-stp_10.42.42.5(pid=7003) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7018): Process ended prematurely: osmo-stp_10.42.42.5(pid=7018) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7018)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7029): Process ended prematurely: osmo-stp_10.42.42.5(pid=7029) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7029)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7043): Process ended prematurely: osmo-stp_10.42.42.5(pid=7043) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7043)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7054): Process ended prematurely: osmo-stp_10.42.42.5(pid=7054) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7054)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7068): Process ended prematurely: osmo-stp_10.42.42.5(pid=7068) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7068)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7080): Process ended prematurely: osmo-stp_10.42.42.5(pid=7080) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7080)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7094): Process ended prematurely: osmo-stp_10.42.42.5(pid=7094) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7105): Process ended prematurely: osmo-stp_10.42.42.5(pid=7105) [trial-2363↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7105)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7120): Process ended prematurely: osmo-stp_10.42.42.5(pid=7120) [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7131): Process ended prematurely: osmo-stp_10.42.42.5(pid=7131) [trial-2363↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7150): Process ended prematurely: osmo-stp_10.42.42.5(pid=7150) [trial-2363↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7150)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7180): Process ended prematurely: osmo-stp_10.42.42.5(pid=7180) [trial-2363↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7191): Process ended prematurely: osmo-stp_10.42.42.5(pid=7191) [trial-2363↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7191)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7201): Process ended prematurely: osmo-stp_10.42.42.5(pid=7201) [trial-2363↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7218): Process ended prematurely: osmo-stp_10.42.42.5(pid=7218) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7218)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7230): Process ended prematurely: osmo-stp_10.42.42.5(pid=7230) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=7251): Process ended prematurely: osmo-stp_10.42.42.5(pid=7251) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7251)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7261): Process ended prematurely: osmo-stp_10.42.42.5(pid=7261) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7261)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7271): Process ended prematurely: osmo-stp_10.42.42.5(pid=7271) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7271)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7289): Process ended prematurely: osmo-stp_10.42.42.5(pid=7289) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7302): Process ended prematurely: osmo-stp_10.42.42.5(pid=7302) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7302)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=7320): Process ended prematurely: osmo-stp_10.42.42.5(pid=7320) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7320)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7330): Process ended prematurely: osmo-stp_10.42.42.5(pid=7330) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7340): Process ended prematurely: osmo-stp_10.42.42.5(pid=7340) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7340)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7357): Process ended prematurely: osmo-stp_10.42.42.5(pid=7357) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7369): Process ended prematurely: osmo-stp_10.42.42.5(pid=7369) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7369)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7387): Process ended prematurely: osmo-stp_10.42.42.5(pid=7387) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7397): Process ended prematurely: osmo-stp_10.42.42.5(pid=7397) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7407): Process ended prematurely: osmo-stp_10.42.42.5(pid=7407) [trial-2363↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7407)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7421): Process ended prematurely: osmo-stp_10.42.42.5(pid=7421) [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7421)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2363↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7443): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7443) [trial-2363↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7443)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2363↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=7734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7734) [trial-2363↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7734)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7744): Process ended prematurely: osmo-stp_10.42.42.5(pid=7744) [trial-2363↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7744)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7759): Process ended prematurely: osmo-stp_10.42.42.5(pid=7759) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7770): Process ended prematurely: osmo-stp_10.42.42.5(pid=7770) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7770)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7785): Process ended prematurely: osmo-stp_10.42.42.5(pid=7785) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7796): Process ended prematurely: osmo-stp_10.42.42.5(pid=7796) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7796)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7810): Process ended prematurely: osmo-stp_10.42.42.5(pid=7810) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7810)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7821): Process ended prematurely: osmo-stp_10.42.42.5(pid=7821) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7821)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7835): Process ended prematurely: osmo-stp_10.42.42.5(pid=7835) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7835)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7846): Process ended prematurely: osmo-stp_10.42.42.5(pid=7846) [trial-2363↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7846)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7860): Process ended prematurely: osmo-stp_10.42.42.5(pid=7860) [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7860)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7874): Process ended prematurely: osmo-stp_10.42.42.5(pid=7874) [trial-2363↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7874)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7888): Process ended prematurely: osmo-stp_10.42.42.5(pid=7888) [trial-2363↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7888)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7899): Process ended prematurely: osmo-stp_10.42.42.5(pid=7899) [trial-2363↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7899)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7917): Process ended prematurely: osmo-stp_10.42.42.5(pid=7917) [trial-2363↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7929): Process ended prematurely: osmo-stp_10.42.42.5(pid=7929) [trial-2363↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7929)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7947): Process ended prematurely: osmo-stp_10.42.42.5(pid=7947) [trial-2363↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7957): Process ended prematurely: osmo-stp_10.42.42.5(pid=7957) [trial-2363↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7967): Process ended prematurely: osmo-stp_10.42.42.5(pid=7967) [trial-2363↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7967)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7984): Process ended prematurely: osmo-stp_10.42.42.5(pid=7984) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7984)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8006): Process ended prematurely: osmo-stp_10.42.42.5(pid=8006) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8024): Process ended prematurely: osmo-stp_10.42.42.5(pid=8024) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8024)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8034): Process ended prematurely: osmo-stp_10.42.42.5(pid=8034) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8034)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8044): Process ended prematurely: osmo-stp_10.42.42.5(pid=8044) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8044)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8061): Process ended prematurely: osmo-stp_10.42.42.5(pid=8061) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8061)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8073): Process ended prematurely: osmo-stp_10.42.42.5(pid=8073) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8073)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=8091): Process ended prematurely: osmo-stp_10.42.42.5(pid=8091) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8091)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8101): Process ended prematurely: osmo-stp_10.42.42.5(pid=8101) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8111): Process ended prematurely: osmo-stp_10.42.42.5(pid=8111) [trial-2363↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8111)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8125): Process ended prematurely: osmo-stp_10.42.42.5(pid=8125) [trial-2363↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8125)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8139): Process ended prematurely: osmo-stp_10.42.42.5(pid=8139) [trial-2363↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8139)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8148) [trial-2363↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8148)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8160): Process ended prematurely: osmo-stp_10.42.42.5(pid=8160) [trial-2363↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8174): Process ended prematurely: osmo-stp_10.42.42.5(pid=8174) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8174)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8185): Process ended prematurely: osmo-stp_10.42.42.5(pid=8185) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8185)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8199): Process ended prematurely: osmo-stp_10.42.42.5(pid=8199) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8199)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8210): Process ended prematurely: osmo-stp_10.42.42.5(pid=8210) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8210)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8227): Process ended prematurely: osmo-stp_10.42.42.5(pid=8227) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8227)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8238): Process ended prematurely: osmo-stp_10.42.42.5(pid=8238) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8238)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8252): Process ended prematurely: osmo-stp_10.42.42.5(pid=8252) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8252)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2363↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8277): Process ended prematurely: osmo-stp_10.42.42.5(pid=8277) [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8288): Process ended prematurely: osmo-stp_10.42.42.5(pid=8288) [trial-2363↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8288)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8302): Process ended prematurely: osmo-stp_10.42.42.5(pid=8302) [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8302)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8313): Process ended prematurely: osmo-stp_10.42.42.5(pid=8313) [trial-2363↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8327): Process ended prematurely: osmo-stp_10.42.42.5(pid=8327) [trial-2363↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8327)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8338): Process ended prematurely: osmo-stp_10.42.42.5(pid=8338) [trial-2363↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8338)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8356): Process ended prematurely: osmo-stp_10.42.42.5(pid=8356) [trial-2363↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8356)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8368): Process ended prematurely: osmo-stp_10.42.42.5(pid=8368) [trial-2363↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8368)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=8386): Process ended prematurely: osmo-stp_10.42.42.5(pid=8386) [trial-2363↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8386)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8397): Process ended prematurely: osmo-stp_10.42.42.5(pid=8397) [trial-2363↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8397)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8407): Process ended prematurely: osmo-stp_10.42.42.5(pid=8407) [trial-2363↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8425): Process ended prematurely: osmo-stp_10.42.42.5(pid=8425) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8425)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=8437): Process ended prematurely: osmo-stp_10.42.42.5(pid=8437) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8437)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8455): Process ended prematurely: osmo-stp_10.42.42.5(pid=8455) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8455)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8465): Process ended prematurely: osmo-stp_10.42.42.5(pid=8465) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8465)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8475): Process ended prematurely: osmo-stp_10.42.42.5(pid=8475) [trial-2363↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8496): Process ended prematurely: osmo-stp_10.42.42.5(pid=8496) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8508): Process ended prematurely: osmo-stp_10.42.42.5(pid=8508) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8508)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8526): Process ended prematurely: osmo-stp_10.42.42.5(pid=8526) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8526)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8536): Process ended prematurely: osmo-stp_10.42.42.5(pid=8536) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8536)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2363↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8570): Process ended prematurely: osmo-stp_10.42.42.5(pid=8570) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8570)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8582): Process ended prematurely: osmo-stp_10.42.42.5(pid=8582) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=8600): Process ended prematurely: osmo-stp_10.42.42.5(pid=8600) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8600)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8620): Process ended prematurely: osmo-stp_10.42.42.5(pid=8620) [trial-2363↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8620)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8633): Process ended prematurely: osmo-stp_10.42.42.5(pid=8633) [trial-2363↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8633)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=8642): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8642) [trial-2363↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8642)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=8644): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8644) [trial-2363↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8644)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=8646): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8646) [trial-2363↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8646)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8648) [trial-2363↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8648)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=8658): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8658) [trial-2363↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8658)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=8669): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8669) [trial-2363↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8669)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8681): Process ended prematurely: osmo-stp_10.42.42.5(pid=8681) [trial-2363↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8681)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8692): Process ended prematurely: osmo-stp_10.42.42.5(pid=8692) [trial-2363↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8706): Process ended prematurely: osmo-stp_10.42.42.5(pid=8706) [trial-2363↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8717): Process ended prematurely: osmo-stp_10.42.42.5(pid=8717) [trial-2363↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8717)] FAIL: register_a5_1_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8728): Process ended prematurely: osmo-stp_10.42.42.5(pid=8728) [trial-2363↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8739): Process ended prematurely: osmo-stp_10.42.42.5(pid=8739) [trial-2363↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=8759): Process ended prematurely: srsepc(pid=8759) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8759)] FAIL: iperf3_bidir.py (19.6 sec) Error: srsepc(pid=9047): Process ended prematurely: srsepc(pid=9047) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9047)] FAIL: iperf3_dl.py (19.7 sec) Error: srsepc(pid=9063): Process ended prematurely: srsepc(pid=9063) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9063)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=9079): Process ended prematurely: srsepc(pid=9079) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9079)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=9095): Process ended prematurely: srsepc(pid=9095) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9095)] FAIL: rrc_idle_mo_ping.py (18.9 sec) Error: srsepc(pid=9112): Process ended prematurely: srsepc(pid=9112) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9112)] FAIL: rrc_idle_mt_ping.py (18.8 sec) Error: srsepc(pid=9128): Process ended prematurely: srsepc(pid=9128) [trial-2363↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9128)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9141): Process ended prematurely: osmo-stp_10.42.42.5(pid=9141) [trial-2363↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9141)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9159): Process ended prematurely: osmo-stp_10.42.42.5(pid=9159) [trial-2363↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9159)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9173): Process ended prematurely: osmo-stp_10.42.42.5(pid=9173) [trial-2363↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9173)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2363↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2363↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9217): Process ended prematurely: osmo-stp_10.42.42.5(pid=9217) [trial-2363↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9217)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9231): Process ended prematurely: osmo-stp_10.42.42.5(pid=9231) [trial-2363↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9245): Process ended prematurely: osmo-stp_10.42.42.5(pid=9245) [trial-2363↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9245)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9259): Process ended prematurely: osmo-stp_10.42.42.5(pid=9259) [trial-2363↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9273): Process ended prematurely: osmo-stp_10.42.42.5(pid=9273) [trial-2363↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9273)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9287): Process ended prematurely: osmo-stp_10.42.42.5(pid=9287) [trial-2363↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2363↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2363↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9329): Process ended prematurely: osmo-stp_10.42.42.5(pid=9329) [trial-2363↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9329)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9345): Process ended prematurely: osmo-stp_10.42.42.5(pid=9345) [trial-2363↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9345)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9359): Process ended prematurely: osmo-stp_10.42.42.5(pid=9359) [trial-2363↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9359)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9373): Process ended prematurely: osmo-stp_10.42.42.5(pid=9373) [trial-2363↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9373)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9388): Process ended prematurely: osmo-stp_10.42.42.5(pid=9388) [trial-2363↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2363↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9416): Process ended prematurely: osmo-stp_10.42.42.5(pid=9416) [trial-2363↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9416)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2363↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9445): Process ended prematurely: osmo-stp_10.42.42.5(pid=9445) [trial-2363↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9445)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9459): Process ended prematurely: osmo-stp_10.42.42.5(pid=9459) [trial-2363↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9474): Process ended prematurely: osmo-stp_10.42.42.5(pid=9474) [trial-2363↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9488): Process ended prematurely: osmo-stp_10.42.42.5(pid=9488) [trial-2363↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9488)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9502): Process ended prematurely: osmo-stp_10.42.42.5(pid=9502) [trial-2363↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9516): Process ended prematurely: osmo-stp_10.42.42.5(pid=9516) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9516)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9533): Process ended prematurely: osmo-stp_10.42.42.5(pid=9533) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9533)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9547): Process ended prematurely: osmo-stp_10.42.42.5(pid=9547) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9547)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9561): Process ended prematurely: osmo-stp_10.42.42.5(pid=9561) [trial-2363↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9561)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9575): Process ended prematurely: osmo-stp_10.42.42.5(pid=9575) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9575)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9589): Process ended prematurely: osmo-stp_10.42.42.5(pid=9589) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9603): Process ended prematurely: osmo-stp_10.42.42.5(pid=9603) [trial-2363↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9603)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9617): Process ended prematurely: osmo-stp_10.42.42.5(pid=9617) [trial-2363↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9631): Process ended prematurely: osmo-stp_10.42.42.5(pid=9631) [trial-2363↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9645): Process ended prematurely: osmo-stp_10.42.42.5(pid=9645) [trial-2363↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] + rm -rf trial-2363/inst + cd trial-2363 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 18:37:11 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363-run.tgz run.2022-12-09_18-37-22 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2363-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12966.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE